Job Description:
Lead and manage a team of data engineers in designing, architecting,
implementing, and supporting our data pipelines and processing flows.
? Collaborate with data scientists and the analytics department to
analyze and understand data sources.
? Provide insights and guidance on database technology and data
modeling best practices.
? Ensure the maintenance of data integrity, managing data and analysis
flows with attention to detail and high responsibility.
? Foster a professional and collaborative team environment, promoting
strong interpersonal skills and accountability.
Requirements:
? Extensive familiarity with frameworks such as Hadoop, Kafka, Nifi, and
Airflow and DB's like Elasticsearch and Splunk.
? Minimum of 6 years of experience as a Big Data Engineer, with at least 2
years in a team management role.
? Proven experience configuring and managing multi-source data flows
and processing large data sets.
? Proficiency in a Linux environment.
? Fluency in Python and a strong understanding of big data store
technologies.
? Strong sense of responsibility, accountability, and attention to detail.
? Excellent interpersonal skills and the ability to perform well as part of a
professional team
Job Qualifications:
Experience in architecting and configuring virtualization, processing
cluster systems, and microservices environments (VMs, Docker,
Kubernetes) is an advantage.
? Prior experience leading a team within a cyber defense or big data
environment.
? Prior experience in Java and TypeScript
Company Occupation:
High Tech
Company Size:
Large (150+)