Senior Data Engineer
Similarweb
שכר לא צויןTel Aviv-Yafo, היברידיסניורמשרה מלאה
משרה חיצונית, ההגשה באתר החברהאושר שהמשרה פתוחה לפני 9 שעות
Design, build, and operate Similarweb’s data ingestion services and pipelines, processing billions of events across large-scale systems. You’ll own ingestion infrastructure end to end and help ensure the quality and reliability of data used in Similarweb’s products.
מה תעשו
- Design, code, and manage online and offline data ingestion pipelines.
- Develop and maintain data infrastructure and apply best practices for building pipelines.
- Build and operate high-scale ingestion services with a focus on availability, reliability, and scalability.
- Monitor production systems, system health, and data quality.
- Lead team design and decision-making processes, and review code and implementations.
- Work with product managers and team leaders to plan and implement development processes.
דרישות
- 5+ years of experience developing code for big data infrastructure.
- Proficiency with technologies such as Databricks, Spark, Airflow, Firehose, SQS, or similar tools.
- Experience working at high scale on AWS or another cloud provider.
- Experience designing large-scale, high-performance production systems.
- Strong communication skills and ability to translate business requirements into technical alternatives.
תנאי סף
- 5+ years of experience developing code for big data infrastructure
הטבות
- חבילת תגמול והטבות תחרותית
- אירועי צוות ומפגשים חברתיים
- הזדמנויות למידה, אימון אישי ופיתוח קריירה
DatabricksApache SparkApache AirflowAmazon FirehoseAmazon SQSAWSData pipelinesSystem design