Job Description:
Lead the implementation of scalable streaming data infrastructure that is architected for massive future growth in terms of amounts of data as well as types of fields and information managed in the system.
Lead the implementation of a scalable serving layer that is architected for massive parallel throughput at extremely low latency.
Be involved in technology selection processes and implementation of new parts of the architecture using these technologies.
Have a deep understanding of our data, how it is acquired, managed, versioned, made discoverable, its relations, and how it can be consumed.
Job Qualifications:
+6 years of proven experience as a Data/Backend Engineer with Scala, Java or Python.
Experience with designing and building ETL processes and data pipelines using at least one streaming technology like Spark structured streaming, Kafka streaming, Flink etc.
Experience with mission critical real-time systems.
Proficiency in SQL with strong analytical skills.
Company Occupation:
High Tech