Senior Python Data Engineer

Our client, a rapidly expanding global technology partner, is looking for a highly skilled Senior Python Data Engineer to join their exceptional Technology and Development team. If you are passionate about demonstrating your expertise and thrive on collaborating with a group of talented engineers, then this role was made for you!

At the heart of technology innovation, our client specializes in delivering cutting-edge solutions to clients across a wide array of sectors. With a strategic focus on finance, banking, and corporate verticals, they have earned a stellar reputation for their commitment to excellence in every project they undertake.
They seek an experienced Senior Python Data Engineer with a strong background in building Extract, Transform, Load (ETL) processes and a deep understanding of AWS serverless cloud environments.

As a vital member of the data engineering team, you will play a critical role in designing, developing, and maintaining data pipelines that facilitate data ingestion, transformation, and storage for our organization.

Your expertise will contribute to the foundation of our data infrastructure, enabling data-driven decision-making and analytics.

Key Responsibilities:

• ETL Pipeline Development: Design, develop, and maintain ETL processes using Python, AWS Glue, or other serverless technologies to ingest data from various sources (databases, APIs, files), transform it into a usable format, and load it into data warehouses or data lakes.

• AWS Serverless Expertise: Leverage AWS services such as AWS Lambda, AWS Step Functions, AWS Glue, AWS S3, and AWS Redshift to build serverless data pipelines that are scalable, reliable, and cost-effective.

• Data Modelling: Collaborate with data scientists and analysts to understand data requirements and design appropriate data models, ensuring data is structured optimally for analytical purposes.

• Data Quality Assurance: Implement data validation and quality checks within ETL pipelines to ensure data accuracy, completeness, and consistency.

• Performance Optimization: Continuously optimize ETL processes for efficiency, performance, and scalability, monitoring and troubleshooting any bottlenecks or issues that may arise.

• Documentation: Maintain comprehensive documentation of ETL processes, data lineage, and system architecture to ensure knowledge sharing and compliance with best practices.

• Security and Compliance: Implement data security measures, encryption, and compliance standards (e.g., GDPR, HIPAA) as required for sensitive data handling.

• Monitoring and Logging: Set up monitoring, alerting, and logging systems to identify and resolve data pipeline issues proactively.

• Collaboration: Work closely with cross-functional teams, including data scientists, data analysts, software engineers, and business stakeholders, to understand data requirements and deliver solutions.

• Continuous Learning: Stay current with industry trends, emerging technologies, and best practices in data engineering and cloud computing and apply them to enhance existing processes.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.

• Proven experience as a Data Engineer with a focus on ETL pipeline development.

• Strong proficiency in Python programming.

• In-depth knowledge of AWS serverless technologies and services.

• Familiarity with data warehousing concepts and tools (e.g., Redshift, Snowflake).

• Experience with version control systems (e.g., Git).

• Strong SQL skills for data extraction and transformation.

• Excellent problem-solving and troubleshooting abilities.

• Ability to work independently and collaboratively in a team environment.

• Effective communication skills for articulating technical concepts to non-technical stakeholders.

• Certifications such as AWS Certified Data Analytics – Specialty or AWS Certified DevOps Engineer are a plus.

Preferred Experience:

• Knowledge of data orchestration and workflow management tools

• Familiarity with data visualization tools (e.g., Tableau, Power BI).

• Previous experience in industries with strict data compliance requirements (e.g., insurance, finance) is beneficial.

What’s In It For You?

• Join an inclusive, collaborative work environment that fosters creativity and curiosity and celebrates success!

• Receive access to the latest tools and technology to create exceptional customer experiences.

• Enjoy career advancement opportunities. Your talent is valued, and they want to see you succeed, not just in your current role but throughout your career.

• After-work socials

We encourage you to apply today if you’re ready to take the reins of your career and be a driving force behind transformative data solutions a chance to unlock the power of data to make a real difference.

Location: North York, Onsite – 3/4 days a week

Full Time: Permanent & Contract