כניסההרשמה
חזרה

Big Data & Data Infrastructure Engineer

VAST Data
שכר לא צויןIsrael - Tel Aviv, Tel Aviv-Yafo, Israel, מרחוקמידמשרה מלאה
משרה חיצונית, ההגשה באתר החברהאושר שהמשרה פתוחה לפני 10 שעות

You will design and deliver scalable data pipelines and infrastructure, working with engineering, product, and customers. The role covers data ingestion, processing, storage, performance tuning, and support for large-scale analytics workloads.

מה תעשו

  • Build distributed data pipelines for real-time and batch workloads.
  • Design, deploy, and troubleshoot hybrid cloud and on-prem environments.
  • Create technical guides, architecture documents, and demo pipelines.
  • Integrate data validation, observability, and governance into pipelines.
  • Benchmark and tune storage and compute layers for performance and scalability.
  • Operate and debug object store-backed data lake infrastructure.

דרישות

  • 2–4 years in software, solutions, or infrastructure engineering, including 2–4 years focused on large-scale data pipelines, storage, or database solutions.
  • Proficiency in Trino and Spark, and working knowledge of Apache Kafka.
  • Python coding experience.
  • Understanding of SQL, NoSQL, and HDFS storage architectures.
  • Experience with distributed systems, stream processing, and event-driven architecture.

יתרון

  • Familiarity with Bash and scripting tools.

תנאי סף

  • 2–4 years in software, solutions, or infrastructure engineering, including 2–4 years focused on large-scale data pipelines, storage, or database solutions
  • Python coding experience
TrinoApache SparkApache KafkaPythonDockerKubernetesTerraformData pipelines