Data Engineer
- Not specified
Posted 2 months ago
About the role
Role: Data Engineer
Location: London, UK (2 days/week onsite)
Role Overvie
w:Looking for a Data Engineer to build and maintain scalable data pipelines and support large-scale analytics systems. You’ll work with high-volume data using modern orchestration frameworks and big data technologie
s.
Key Responsibiliti
- es:Build and maintain data pipelines using Pyt
- honDevelop and optimize ETL workfl
- owsWrite complex SQL queries (Presto / Spark S
- QL)Work with Spark for large-scale data process
- ingEnsure data quality, monitoring, and reliabil
- ityCollaborate with cross-functional teams (Data Science, Product, Analyti
cs)
Tech S
- tackLanguages: Python,
- SQLTools: Dataswarm (Airflow-like), Spark, Presto,
- HiveOthers: Data catalog, dashboarding, lineage & monitoring t
ools
Required S
- killsStrong Python + SQL expe
- rtiseExperience with data pipeline/orchestration tools (Airflow or sim
- ilar)Hands-on with Spark / big data proce
- ssingGood understanding of data warehousing con
- ceptsExperience working with large dat
- asetsExperience in FAANG-scale environ
- mentsExposure to data lineage / metrics frame
- worksFamiliarity with real-time monitoring