Big Data Engineer
Placer.ai
שכר לא צויןRamat Gan, Israel, היברידיסניורמשרה מלאה
משרה חיצונית, ההגשה באתר החברהאושר שהמשרה פתוחה לפני 10 שעות
As a Senior Big Data Engineer in the Mobility Group, you will design, develop, and maintain the data infrastructure behind Placer.ai’s location analytics platform. You will build and operate scalable data pipelines and collaborate with teams across the company to deliver reliable data solutions.
מה תעשו
- Design, build, and optimize scalable data pipelines.
- Implement data validation, cleansing, and enrichment.
- Optimize data processing and storage performance.
- Design and manage cloud data infrastructure using GCP and AWS.
- Monitor pipelines, troubleshoot issues, and maintain high availability.
- Provide technical guidance and mentorship to junior data engineers.
דרישות
- Hands-on Apache Spark experience building and operating production pipelines.
- Proficiency in PySpark or Scala for Spark development.
- Experience delivering ETL pipelines and data integration at scale.
- Solid SQL skills and knowledge of data modeling.
- Production experience with a cloud platform and distributed systems; familiarity with Parquet or Delta Lake.
יתרון
- Experience with Apache Airflow or other pipeline orchestration tools.
- Exposure to geospatial or location analytics.
- Familiarity with Hadoop ecosystem components.
- Experience with both Python and Scala.
תנאי סף
- Hands-on experience building and operating Apache Spark pipelines in production
- Proficiency in PySpark or Scala for Spark development
- Experience delivering ETL pipelines and data integration at scale
- Production experience with a cloud platform
הטבות
- Competitive salary
- Excellent benefits
Apache SparkPySparkScalaETLSQLData modelingAWSGCP