Data Engineer – Microsoft Fabric Developer (Spark Notebooks)
Location: Remote
Department: Digital Solutions / Data Engineering
Reports To: Data Engineering Lead / Director
Job Type: Full-time
About AIM
Architecture in Motion Inc. (AIM) is a Canadian technology consulting firm that supports organizations across public and private sectors with cloud platforms, data engineering, analytics, and enterprise technology solutions.
We partner with clients to deliver scalable, secure, and data-driven systems, with a strong focus on modern cloud platforms, including Microsoft Azure and Microsoft Fabric.
Role Overview
AIM is seeking a Data Engineer – Microsoft Fabric Developer with strong expertise in Spark Notebooks and modern data platforms.
This role is a hands-on individual contributor position focused on building, optimizing, and managing data pipelines, transformations, and analytics solutions within Microsoft Fabric. The ideal candidate will work closely with data analysts, Power BI developers, and solution architects to deliver high-quality, scalable data solutions.
Key Responsibilities
Data Engineering & Development
- Design, develop, and maintain data pipelines using Microsoft Fabric
- Develop and optimize Spark Notebooks (PySpark / Spark SQL) for data transformation and processing
- Build scalable ETL/ELT workflows for structured and unstructured data
Data Platform & Architecture
- Work within Microsoft Fabric ecosystem (Data Factory, Lakehouse, Warehousing)
- Design and manage data models and storage layers (Bronze, Silver, Gold architecture)
- Ensure performance optimization and efficient data processing
Integration & Data Management
- Integrate data from multiple sources, including:
- APIs
- Databases
- Cloud storage systems
- Ensure data quality, validation, and governance best practices
Analytics & Collaboration
- Collaborate with Power BI developers and analysts to support reporting requirements
- Enable clean, structured datasets for reporting and visualization
- Support business teams with data insights and troubleshooting
Optimization & Support
- Monitor and optimize data pipelines and Spark workloads
- Troubleshoot data issues and ensure reliability and performance
- Support deployment and CI/CD processes for data solutions
Documentation & Process Improvement
- Maintain technical documentation for data pipelines and workflows
- Support standardization of data engineering processes and best practices
Required Qualifications
Education
- Bachelor’s degree in Computer Science, Data Engineering, IT, or a related field
Experience
- 4–6+ years of experience in data engineering or data platform development
- Hands-on experience with Microsoft Fabric or Azure Data Platform
- Strong experience working with Spark Notebooks (PySpark / Spark SQL)
Technical Skills
- Expertise in:
- Microsoft Fabric
- Spark / PySpark / Spark SQL
- Data pipelines (ETL/ELT)
- Experience with:
- Azure Data Factory / Synapse / Fabric pipelines
- Data Lake / Lakehouse architecture
- SQL and relational databases
- Understanding of:
- Data modeling concepts
- Data governance and quality frameworks
Core Competencies
- Strong problem-solving and analytical skills
- Ability to work in a cross-functional, collaborative environment
- Strong communication and documentation skills
- Ability to manage tasks independently in a remote setup
Nice to Have
- Experience with Power BI and data visualization
- Familiarity with CI/CD pipelines and DevOps practices
- Experience with large-scale enterprise data platforms
What We Offer
- 100% remote work environment
- Opportunity to work on modern cloud and data platforms (Microsoft Fabric)
- Exposure to enterprise-scale data and analytics projects
- Collaborative and growth-focused culture
Application Instructions
Please share examples of data engineering projects, GitHub repositories (if available), or relevant certifications in Microsoft/Azure data technologies.
