Staff Data Engineer Job at Elastic, United States

Zm5obkRabUZyWXJsVjlUbVZ5eXdFQmUxR1E9PQ==
  • Elastic
  • United States

Job Description

What is The Role

We are seeking a Staff Data Engineer to join our Data Engineering & Architecture team. In this role, you will contribute to our mission of building a world-class Data Platform. Your work will directly impact our strategy by making it easier for internal customers to leverage data as a strategic asset. This position offers an excellent opportunity to help craft critical initiatives that support real business outcomes.

What You Will Be Doing



  • Assist in developing, implementing, and optimizing data pipelines using Apache Airflow for workflow orchestration.

  • Develop and maintain ETL/ELT processes using Apache Spark, Apache Iceberg, and dbt.

  • Implement real-time data streaming solutions using Apache Kafka and Apache Flink.

  • Use Terraform for infrastructure-as-code to deploy resources on Google Cloud Platform (GCP).

  • Document & Guide Users on Best Practices for using our platform.

  • Monitor and Audit the Data Platform to ensure policies and procedures are maintained.

  • Participate in code reviews to improve code quality and validate standard processes are met.

  • Process Access Requests ensuring all approval processes are followed.

What You Bring



  • Demonstrated interest in data engineering through personal projects, coursework, or contributions to open-source projects.

  • Strong Analytical and Problem Solving Skills.

  • Excellent Verbal and Written Communication Skills.

  • Eagerness to learn and stay updated with the latest data engineering trends.

  • Proficiency in programming languages, particularly Bash, Python, and SQL.

  • Knowledge of database systems, including OLAP, OLTP, Document, and Vector databases.

  • General understanding of data pipelines, ETL/ELT processes, data modeling, and data warehousing concepts.

  • Basic Knowledge of Git and DevOps practices.

  • Proficiency with data processing frameworks such as Kafka, Flink, and Spark.

  • Experience with Apache Iceberg and Data Lake houses

 

Job Tags

Full time,

Similar Jobs

IDR, Inc.

Junior Project Manager Job at IDR, Inc.

IDR is seeking a Junior Project Manager to join one of our top clients for a remote opportunity. This role is within a dynamic organization focused on delivering complex projects efficiently and effectively. The position offers remote work flexibility and is ideal for... 

Papa John's

Training Implementation & Support Coordinator Job at Papa John's

 ...our strength and competitive advantage. Bring your flavor to the Papa John's team today! Job Summary The Training Implementation & Support Coordinator plays a key role in supporting the launch, completion, and sustainment of training initiatives that help our... 

KCO Resource Management

Food Safety Manager Job at KCO Resource Management

 ...Job Description Food, Safety and Quality Manager Were working with a leading beverage manufacturing company in Ohio thats...  ...supervisory role ~ HACCP certified and very strong HACCP and regulatory skills ~ Strong leadership, communication, and problem-solving... 

Arrow Stage Lines

Lead Bus Cleaner Job at Arrow Stage Lines

 ...and direction. The Lead Motorcoach Detailer will work with the Cleaning Supervisor in being responsible for overseeing the cleaning and...  ...is $24.25 per hour! Arrow Stage Lines is the premier charter bus company in America. Arrow Stage Lines is family owned and has been...