The Data Engineer will design and implement data pipelines, ensure data quality, manage datasets, and collaborate with teams to optimize data structures and processes.
At Uni Systems, we are working towards turning digital visions into reality. We are continuously growing and we are looking for a Data Engineer to join our UniQue team.
What will you be doing in this role?
- Designs and implements data pipelines and data stores to acquire and prepare data.
- Applies data engineering standards and tools to create and maintain data pipelines and extract, transform and load data.
- Carries out routine data quality checks and remediation Programming/software development.
- Designs, codes, verifies, tests, documents, amends and refactors moderately complex programs/scripts.
- Applies agreed standards and tools to achieve a well-engineered result.
- Proposes practical solutions to resolve issues.
- Collaborates in reviews of work with others as appropriate.
- Defines the software modules needed for an integration build and produces a build definition for each generation of the software.
- Assesses the integrity of data from multiple sources.
- Provides advice on the transformation of data from one format/medium to another.
- Enables the availability, integrity and search ability of information through the application of formal data and metadata structures and protection measures.
- Applies standard data modelling and design techniques based upon a detailed understanding of requirements.
- Establishes, modifies and maintains data structures and associated components.
- Communicates the details of data structures and associated components to others using the data structures and associated components
Requirements
What will you be bringing to the team?
- Have at least a high school certificate.
- Ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management in an on premise environment.
- At least 4 years' experience planning and maintaining data lakes, databases and pipeline processes, both batch-wise and (near) real-time.
- Experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using data integration technologies on premise.
- Experience in using of data engineering tools to support data science, data analytics and data visualization (KNIME, SQL Server, Power BI is the preferred toolset).
- Familiarity with KNIME Analytics Platform and Server is preferred
- Experience with state-of-the-art data engineering, analytics, data integration and pipeline tools/programming language (Python).
- Solid understanding of data security best practices, including data encryption, access controls, authentication/authorization mechanisms, and compliance requirements.
- Experience with monitoring and logging tools to ensure the reliability and performance of data pipelines.
- Familiarity with containerization and orchestration tools such as Docker and Kubernetes is a plus.
- Knowledge of best practice of software development. E.g. CI/CD pipelines, unit/functional testing, following styling guides is a plus.
- Experience working within NCIA or similar defence-related environments is considered an advantage.
- Knowledge of NATO Communication and Information Systems Infrastructure is considered an advantage.
- Prior experience working in an international environment comprising both military and civilian elements is considered an advantage.
- Proficiency in English language a a C1 level.
Top Skills
Docker
Knime
Kubernetes
Power BI
Python
SQL Server
Similar Jobs
Information Technology • Logistics • Other • Software • Consulting
Drive the development of Data and AI features, design scalable data architectures, ensure reliability and accuracy of data solutions, shape DevOps workflows, and collaborate with analysts and product managers to transform complex data into practical solutions.
Top Skills:
AirflowDbtMatplotlibNumpyPandasPythonScikit-LearnSeaborn
17 Days Ago
Information Technology • Software
The role involves maintaining EUMETSAT Copernicus software, correcting anomalies, optimizing performance, and documenting the code while working collaboratively in a team.
Top Skills:
C/C++GitLinuxMatlabPython
Information Technology
The (Senior) Data Engineer designs and maintains data pipelines, collaborates with clients on data needs, and develops dashboards for insights.
Top Skills:
AirflowAmazon AwsSparkDatabricksMs AzureNosql DatabasesPythonRdbmsSQL
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.


