Mid-level Data Engineer for Circle Gas
Recruit IT
Help build and maintain the infrastructure that powers our decision-making.
You will join a team responsible for a massive AWS Data Lakehouse environment, handling high volume telemetry data from our IoT network.
As a Data Engineer, you will move beyond simple tasks to owning full features of the data pipeline. You will write production-grade ETL code, ensure data quality, and contribute to the architectural design of our maturing data platform.
Key Responsibilities
- Pipeline Development: Design, build, and maintain scalable data pipelines using PySpark and Apache Airflow to ingest and process IoT telemetry data
- Lakehouse Architecture: actively contribute to the management of our data lakehouse using Apache Iceberg on Amazon S3
- Data Quality: Implement automated testing and monitoring to ensure the accuracy and reliability of data flowing into the lake
- Infrastructure as Code: Utilize Terraform to manage and deploy data infrastructure, ensuring repeatable and secure environments
- Collaboration: Partner with analysts and software engineers to understand data requirements and deliver efficient solutions
- Growth: Participate in release planning and design reviews, ensuring that we are building sustainable and scalable data products
- Experience: Solid experience in Data Engineering, capable of taking a feature from concept to production
- Tech Stack: Strong coding skills in Python and SQL
- Big Data Tools: Experience with Apache Spark (PySpark) and workflow orchestration tools like Airflow
- Modern Data Architecture: Familiarity with Table Formats (e.g., Iceberg, Delta Lake) and AWS storage (S3)
- Bonus: Exposure to Machine Learning concepts or ML Ops pipelines
Qualifications
About Circle Gas
Circle Gas is a revolutionary company focused on transforming the lives of people in sub-Saharan Africa and beyond.
We are scaling rapidly to support 2 million households (10 million people), providing clean, safe, and affordable cooking fuel. Data is the lifeblood of our operation—from billing 10 million customers to optimizing logistics in remote areas.
.
Stillingsdetaljer
Arbejdssted
København V
Ansøgningsfrist
as soon as possible
Kontaktperson
Johni Petersen
[email protected]
Mobil: +45 26 37 75 35
Opslaget er indhentet automatisk fra virksomhedens jobsider og vises derfor kun som uddrag. Log ind for at se det fulde opslag eller gå videre til opslaget her:
