As a Principal Data Engineer, you will be integral to the security research group, designing, building, and maintaining the data pipelines and data frameworks that are the backbone of our cyber attack detection capabilities. You will work closely with top security and AI researchers, enabling their work and seeing the direct impact of your contributions on our services and the day-to-day effectiveness of the research team.
Key Responsibilities
Lead the design and implementation of end-to-end, complex data pipelines and data platforms in cloud environment.
Collect, analyze, and translate complex data requirements from various stakeholders including data analysts, developers, and Cyber security researchers.
Develop robust, scalable Cloud based data solutions using Python and distributed processing frameworks such as Apache Beam (Dataflow) , GKE , Spark , etc.
Utilize AI as part of the development cycle, including generating, reviewing, and testing code via prompts.
Model and manage data within cloud MPP databases and data lakes such as BigQuery, Redshift, or Snowflake.
Key Responsibilities
Lead the design and implementation of end-to-end, complex data pipelines and data platforms in cloud environment.
Collect, analyze, and translate complex data requirements from various stakeholders including data analysts, developers, and Cyber security researchers.
Develop robust, scalable Cloud based data solutions using Python and distributed processing frameworks such as Apache Beam (Dataflow) , GKE , Spark , etc.
Utilize AI as part of the development cycle, including generating, reviewing, and testing code via prompts.
Model and manage data within cloud MPP databases and data lakes such as BigQuery, Redshift, or Snowflake.
Requirements:
4+ years experience as a Senior Data Engineer / Data engineer lead (Hands-On) / Data architect – working with Cloud environments
Experience in leading and implementing end to end complex Data pipelines and data platforms
Experience with collecting , analyzing and syncing complex data requirements from various data users such as: Data Analysts , Developers , Researchers and Managers
4+ years Experience with Data Modeling using various Data platforms and databases
4+ years Python experience – focused on Data related areas and distributed processing (Experience with at least one of the following:
Spark, GCP DataFlow (Apache Beam), GKE , etc)
Experience with Docker & Kubernetes / GKE
4+ Years experience with Cloud MPP Databases / Data Lakes such as: BigQuery , Redshift , Snowflake , Azure SQL DWH , Azure Kusto
Fluent with SQL
AI:
Using AI as part of the development cycle is second nature for you.
Experience generating code via Prompts and closing the loop by reviewing and testing
Experience writing MCPs , Skills and mds
Soft skills:
Collaborative Mindset: A team-first leader who believes that the best data products are built through collective genius and open communication.
Bridge Builder: Naturally connects the dots between diverse teams-from DevOps to Data Science-to break down silos and streamline data delivery.
Growth-Minded: Approaches feedback as a tool for evolution; possesses the grit to pivot and find the "silver lining" in complex technical setbacks.
Execution Passionate: Genuinely loves the "how" as much as the "what," finding joy in the pursuit of clean code and the deployment of mission-critical pipelines.
Preferred Qualifications
GCP experience
Data science background
Cyber security knowledge.
4+ years experience as a Senior Data Engineer / Data engineer lead (Hands-On) / Data architect – working with Cloud environments
Experience in leading and implementing end to end complex Data pipelines and data platforms
Experience with collecting , analyzing and syncing complex data requirements from various data users such as: Data Analysts , Developers , Researchers and Managers
4+ years Experience with Data Modeling using various Data platforms and databases
4+ years Python experience – focused on Data related areas and distributed processing (Experience with at least one of the following:
Spark, GCP DataFlow (Apache Beam), GKE , etc)
Experience with Docker & Kubernetes / GKE
4+ Years experience with Cloud MPP Databases / Data Lakes such as: BigQuery , Redshift , Snowflake , Azure SQL DWH , Azure Kusto
Fluent with SQL
AI:
Using AI as part of the development cycle is second nature for you.
Experience generating code via Prompts and closing the loop by reviewing and testing
Experience writing MCPs , Skills and mds
Soft skills:
Collaborative Mindset: A team-first leader who believes that the best data products are built through collective genius and open communication.
Bridge Builder: Naturally connects the dots between diverse teams-from DevOps to Data Science-to break down silos and streamline data delivery.
Growth-Minded: Approaches feedback as a tool for evolution; possesses the grit to pivot and find the "silver lining" in complex technical setbacks.
Execution Passionate: Genuinely loves the "how" as much as the "what," finding joy in the pursuit of clean code and the deployment of mission-critical pipelines.
Preferred Qualifications
GCP experience
Data science background
Cyber security knowledge.
This position is open to all candidates.
