Senior Data Engineer
AppsFlyer
שכר לא צויןHerzliya, היברידיסניורמשרה מלאה
משרה חיצונית, ההגשה באתר החברהאושר שהמשרה פתוחה לפני 11 שעות
Own the technical direction of data pipelines that process web events, from ingestion through distributed processing to the serving layer. Lead pipeline design and technical planning for a team building web attribution products used by advertisers and marketers.
מה תעשו
- Build and improve end-to-end pipelines for web events, with freshness and accuracy SLAs.
- Lead pipeline technical design, write design documents, review designs, and make architecture trade-offs.
- Work with the team lead on roadmap, planning, priorities, and project deliverables.
- Represent the team in technical discussions with Product, R&D, and partner teams.
- Own production incidents and implement lasting fixes.
דרישות
- 6+ years in Data or Big Data Engineering, including building and running production systems at scale.
- B.Sc. in Computer Science or equivalent.
- Deep hands-on Apache Spark experience, including execution plans, partitioning, memory management, and debugging skew and performance problems.
- Experience with a cloud analytical warehouse and workflow orchestration in production-scale cloud environments.
- Strong programming fundamentals and hands-on use of AI tools in daily engineering work.
יתרון
- BigQuery; GCP preferred.
- Scala; Python for orchestration.
- Experience with attribution or AdTech data systems and attribution models.
- Experience with Dataform, dbt, data-mesh or data-product platforms, Kafka, streaming systems, or production LLM or ML pipelines.
תנאי סף
- 6+ years of experience in Data or Big Data Engineering
- B.Sc. in Computer Science or equivalent
- Deep hands-on Apache Spark experience
- Experience with a cloud analytical warehouse
Apache SparkData EngineeringData ModelingBigQueryAirflowScalaPythonSQL