Speedcast Logo

Speedcast

Data Engineer

Sorry, this job was removed at 03:23 a.m. (GMT) on Tuesday, Nov 19, 2024
Be an Early Applicant
Remote
Remote

Similar Jobs

10 Days Ago
In-Office or Remote
2 Locations
Junior
Junior
Insurance
As a Data Engineer, you will design and build data solutions, develop and implement data pipelines, and maintain databases while ensuring adherence to technical standards.
Top Skills: Azure Data FactoryAzure SynapseEtl TechnologiesPower BIPysparkPythonSQL Server
12 Days Ago
Easy Apply
Remote
UK
Easy Apply
Senior level
Senior level
Cloud • Information Technology • Professional Services • Software • Consulting
The Principal Data Engineer designs and builds large-scale backend services and data pipelines, leading technical initiatives and mentoring junior engineers.
Top Skills: ClickhouseDockerGoJavaKubernetesPostgresPythonRust
15 Days Ago
Remote
United Kingdom
Mid level
Mid level
Artificial Intelligence • Information Technology • Software
The Data Engineer will architect and maintain the data infrastructure, focusing on high-volume logs and performance pipelines to support observability and analytics for various teams.
Top Skills: Analytical DatabasesData PipelinesDatadogGrafanaOpentelemetryPrometheus

Data Engineer

Job Title:

Data Engineer

Overview of Position:

As a Data Engineer, you will play a pivotal role in shaping the infrastructure that handles a company's data assets, ensuring that data flows efficiently and securely from source to insight. You will be part of a team that will be responsible for designing, building, and maintaining scalable data pipelines and storage systems that support analytics and data-driven decision-making with cloud technologies (AWS).

A successful candidate will be capable of working independently, actively and confidently promoting improvements, and incorporating new technologies, throughout the lifecycle of each product. It is also essential to the role, the ability to both teach and learn from other members of the team.

This is a new team that is being created for a new project, where you will have an active participation in both deciding parts of the architecture as well as validate, challenge and help all other members of the team. This includes some data-ops, that you will be expected to have some knowledge of and Data Science that you will not need to be an expert on but will be expected to learn from and provide all the help and support that you can. Since this will be a small team, some work outside data engineering such as dev-ops and creation of reports and dashboards might also be required, along with any other work that might be needed for the success of the project.

What you will do:

  • Design, develop, test and debug of applications, as per requirements.
  • Participate in agile ceremonies and backlog grooming and prioritization.
  • Provide mentoring and guidance to software developers of varying experience.
  • Actively participate in the design, construction, and maintenance of scalable, secure, compliant and reliable data pipelines and architectures.
  • Collaborate with data scientists, analysts, IT teams, and other stakeholders to ensure data systems meet organizational requirements.
  • Cultivate a team culture promoting transparency, accountability and growth.
  • Monitoring the performance of data systems and implementing improvements to enhance efficiency and reduce latency.
  • Propose best practices for data engineering processes and promoting a culture of continuous improvement.
  • Participating in the strategic planning of data projects, setting objectives, and outlining the roadmap for execution.
  • Communicating complex data-related concepts and progress to non-technical stakeholders to support informed decision-making.

What we need from you:

  • Experience in Python.
  • Experience in SQL (at least one flavor).
  • Experience with source version control (using git).
  • Experience working with Scrum and the Agile methodology.
  • Experience with AWS.
  • Knowledge of security best practices on AWS, for data related products.
  • Experience in using Docker.

Even better if you have any of:

  • Really good AWS experience (certifications are also a big plus).
  • Experience with the star schema design for Analytics (preferably Kimball inspired).
  • Knowledge (or experience) of Data Lakes and the AWS Data Lake Formation.
  • Knowledge (or experience) of Data Lake Houses.
  • Experience with bitbucket.
  • Knowledge (or experience) of technologies such as Spark and pySpark.
  • Understanding of MPP and columnar DB engines and technologies such as parquet files.
  • Some experience with data sets, and data visualization tools.
  • Knowledge (or experience) of deployment tools on AWS such as CodePipeline and CodeDeploy.
  • Knowledge (or experience) of CloudFormation.
  • Good knowledge of GDPR.

What we need from you:

  • Development and maintenance of data pipelines.
  • Working on the evaluation and adoption of new data technologies and architectures.
  • Proactively help with the vision for BI and Data Warehousing across a product vertical and define and execute a plan to achieve that vision.
  • Actively ensuring data quality and pipeline reliability.
  • Collaborating with data scientists and analysts to understand data needs.
  • Promoting initiatives to foster a data-centric culture within the organization
  • Build cross-functional relationships with Data Scientists, Product Managers and Software Engineers to understand data needs and deliver on those needs.
  • Good understanding of the software development life cycle.
  • Excellent communication skills.

Working at Speedcast:

At Speedcast, we want people that like adventure. Who are motivated by work that takes uncommon ingenuity and thinking outside the box. Who relish the idea of working in an industry undergoing massive transformation. If you want to be part of a global team responsible for connecting the world, then you’re in the right place.

We're always pushing forward, never standing still. When people rely on you and your team to stay connected, it brings everyone closer together. We’re united by the adrenaline of high-stakes projects and our love of getting the job done right. You will experiment, learn and grow here, right alongside us, every single day.

Find great opportunities to make an impact. We have a "one team, one dream" mentality. We work together to make great things happen. Working at Speedcast isn't just a job, it's a career that you can take to new levels.

Top reasons why people love working at Speedcast:

  • Our global presence – you get to work with clients and colleagues all over the world, in every continent

  • Talented teammates – your co-workers are the best and brightest in the industry

  • Industry leadership – be part of the latest advancements shaping the future of communications

  • Ability to develop skills – work across departments to gain new skills and valuable experience

  • Choose your environment – we have an environment to fit your temperament. Choose between a traditional desk job or work in the field.

  • Grow your career - Guide your career in the direction you want. Gain new titles and responsibilities through our internal promotion system.

  • Work on diverse projects – every day is different with our customers from a range of industries around the world

Speedcast is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, veteran status, and other protected characteristics. The US EEO is the Law poster is available by visiting the below link:

https://www.eeoc.gov/employers/upload/poster_screen_reader_optimized.pdf

Speedcast does not accept or retain unsolicited résumés or phone calls and/or respond to them or to any third party representing job seekers.

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account