דרושים » הנדסה » Senior Data Engineer

משרות על המפה
 
בדיקת קורות חיים
אבחון און ליין
VIP
הפוך ללקוח VIP
רגע, משהו חסר!
נשאר לך להשלים רק עוד פרט אחד:
 
שירות זה פתוח ללקוחות VIP בלבד
AllJObs VIP
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
08/04/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Our Research team is growing, and we are looking for a Senior Data Engineer to join the team.
Not Your Typical Senior Data Engineer Role
You're a crucial pivot in our R&D unit, ensuring our data flows seamlessly, is stored efficiently, and can be accessed and interpreted for justice at scale. You will be responsible for designing our data architecture, implementing and maintaining data pipelines from various sources, and building our databases.
There is no one way of doing things. We are open to new ideas and we encourage creativity, new initiatives and entrepreneurial minds.
Responsibilities:
You will devise scalable solutions to enhance the capabilities of our legal data team to analyze factual information and extract legal implications from it.
Design data analytics modeling solutions with the data science and ML engineers
Collaborate with peer engineering teams (backend & frontend developers and architects) as well as data scientists, product managers, and data analysts to understand business priorities and translate these requirements into data models.
Work with DevOps and engineers to design and implement our infrastructure.
Requirements:
SQL expertise, working with various databases (relational and NoSQL), data warehouses, and 3rd party data sources and AWS cloud services.
4+ Years of experience as a Data Engineer / Backend Developer.
4+ Years of experience with a programming language (Python, Java, NodeJS).
Experience with designing Databases and Data pipelines and complex architecture.
English ( spoken & written).
Advantages for:
Knowledge of advanced Bigdata topics and distributed computing.
Knowledge of K8s, Docker, Spark, Elastic, and Airflow.
Familiarity with data warehousing concepts and systems.
This position is open to all candidates.
 
Hide
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7685026
סגור
שירות זה פתוח ללקוחות VIP בלבד
משרות דומות שיכולות לעניין אותך
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
07/04/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Data Engineer.
As a Senior Data Engineer, you will play a pivotal role in our Data Engineering team, driving a multitude of responsibilities essential to fueling our groundbreaking R&D endeavors. Youll have the autonomy to explore and implement cutting-edge technologies and data solutions, collaborating with diverse team of data scientists, developers, analysts, and stakeholders. Every day will present new learning opportunities and challenges as we strive together to reshape the future of work.
Responsibilities:
Design, develop, and maintain scalable data pipelines and infrastructure to support the collection, processing, and analysis of large volumes of data.
Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand data requirements and develop solutions that meet business needs.
Implement best practices for data governance, security, and quality assurance to ensure the integrity and reliability of our data assets.
Optimize and tune existing data pipelines and processes for improved performance and efficiency.
Stay up to date with current best practices in the big data field.
Mentor and coach other members of the data engineering team, providing guidance and support to help them grow their skills and expertise.
Requirements:
5+ years of experience working as a data engineer or similar role, with a proven track record of designing and implementing data solutions MUST.
Proficiency in programming languages such as Python, Java, or Scala, with experience building and maintaining data pipelines using frameworks like Apache Spark, Apache Kafka, or similar.
Strong SQL skills and experience working with relational and non-relational databases (e.g., MySQL, MongoDB).
Hands-on experience with cloud platforms such as AWS, GCP, or Azure, and familiarity with services like AWS Glue, Google BigQuery, or Azure Data Factory.
Hands-on experience with ETL/ELT processes, data ingestion, data transformation, data modeling, and monitoring.
Deep experience of one or more of these technologies: Airflow, dbt, Snowflake, Presto / Trino, Kafka, SQS, Sagemaker, Kubernetes, Argo, Terraform, Debezium.
Strong communication and collaboration skills, with the ability to effectively work with cross-functional teams and communicate technical concepts to non-technical stakeholders.
Quick learner, team player, independent, imaginative and motivated individual with a passion for data!
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7682320
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
03/04/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Required Senior Data Engineer
Our Mission:
Our mission is to enable enterprises to be more strategic, proactive, and make data-driven decisions to optimize their facility security, IT infrastructure and sustainability operations.
Job Summary:
As a Senior Data Engineer you will be helping us design and build a flexible and scalable system that will allow our business to move fast and innovate. You will be expected to show ownership and responsibility for the code you write, but it doesn't stop there. at our company, you are encouraged to think big and help out in other areas as well.
Key focuses:
Designing and writing code that is critical for business growth
Mastering scalability and enterprise-grade SAAS product implementation
Sense of ownership - leading design for new products and initiatives as well as integrating with currently implemented best-practices
Review your peer's design and code
Work closely with product managers, peer engineers, and business stakeholders.
Requirements:
Minimum Requirements:
5+ years of experience as a hands on software engineer (Python, TypeScript, Node.JS)
Hands on experience in managing major clouds vendors infrastructure (AWS, GCP, Azure)
Hands on experience in designing and implementing data pipelines, distributed systems and restful APIs
Proficiency with SQL, modeling and working with relational and non databases, and pushing them past their limits
Experience working with CI/CD systems, Docker and orchestration tools such as Kubernetes
Enjoy communicating and collaborating, sharing your ideas and being open to honest feedback
The ability to lead new features from design to implementation, taking into consideration topics such as performance, scalability, and impact on the greater system.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7679147
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
02/04/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are seeking an experienced Data Engineer to join our dynamic team of analytics experts. In this role, you will play a pivotal part in both data ops and data engineering functions, contributing to the enhancement and maintenance of our data integration and pipeline processes, as well as ensuring the robustness and scalability of our data platform.
The ideal candidate is someone who thrives in a fast-paced environment, adept at both data engineering practices and DevOps principles.
You should be passionate about optimizing data systems and possess a strong desire to continuously improve our companys data architecture to support evolving products and data initiatives.
In this role, you will be responsible for:
Develop and maintain ETL/ELT/Streaming processes and SQL queries for efficient data movement.
Design and implement scalable, automated processes for large-scale data analyses.
Engage with stakeholders to understand data requirements and build datasets accordingly.
Collaborate with teams to enhance data models and promote data-driven decision-making.
Contribute to the long-term strategy and architecture of the data platform.
Maintain data lake pipelines and ensure adherence to schema standards.
Apply data security standards and seek ways to optimize data flow.
Serve as the point of contact to the DevOps team and handle MLOps operations.
Requirements:
4+ years of experience as a Data Engineer or similar role.
3+ years of Python development experience.
Bachelors or Masters degree in Computer Science or related field.
Proficiency in SQL, data modeling, and building ELT/ETL pipelines.
Experience with AWS cloud environment and big data technologies.
Proficiency in Kubernetes and containerization technologies.
Familiarity with Kafka, Airflow, and DBT is desirable.
Experience with at least one big data environment such as Snowflake, Vertica, or Redshift.
Excellent analytical skills and experience with creating pipelines.
Familiarity with AWS Sagemaker or other ML platforms is advantageous.
Serve as the point of contact to the DevOps team and handle MLOps operations.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7676698
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
15/04/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Required Data Infrastructure Engineer
Job Description:
Design, build, and maintain scalable data solutions and infrastructure to support data processing, data quality and data tools for different data professionals and consumers in the organization
Develop and maintain generic processes to ingest data automatically from various sources into our data lake/data warehouse
Lead end to end projects in the data infrastructure group, working closely with users and leaders from the Data Engineering Guild
Collaborate with cross-functional infrastructure teams to integrate data engineering solutions into our products and services to create high-quality deliverables
Stay up-to-date with the latest trends and technologies in data engineering and recommend best practices to improve our data infrastructure.
Requirements:
3+ years of experience as a Data Engineer or Backend Developer with a focus on Python, Spark/Flink/Kafka, and experience cloud architecture (AWS services, k8s and more)
You are experienced in writing complex SQL queries and data pipelines for big data processing
You are an independent, self-learner who is passionate about data and can translate business and technical needs into data models or services
You have strong problem-solving skills and the ability to work independently
Youre a team player with excellent communication skills
Experience with Airflow, Great Expectations, Open Metadata, data governance practices or any data solutions would be an advantage
Experience building microservices in Python using FastAPI, Flask or similar would also be an advantage.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7693927
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
14/04/2024
Location: Tel Aviv-Yafo
Job Type: Full Time
we are looking for a Senior Engineer with a data engineering background to join our growing ML Platform team. This is a great opportunity to enter the world of Machine Learning. Together well provide tools to develop more effective models, get them into production faster, and ensure that they continue to perform well over time.
What you will be doing:

Designing, building, and maintaining the ML infrastructure that allows models to make billions of real-time decisions every year.
Building a platform that enables managing a full ML model lifecycle - from researching to training, deploying, and serving predictions in real-time.
Building distributed data processing pipelines to support model development.
Acting as a consultant to researchers, data scientists, and expert analysts and enabling them to research new models faster and with greater precision by providing cutting-edge tooling.
Expanding our ML infrastructure to make it scalable, quick, and efficient to bring diverse models to production and to monitor their performance and drift over time.
Expanding the pool of internal customers able to use ML. Work with them to understand their needs and help them make the most of the infrastructure that well provide.
Acting as an advocate for MLOps, continually improving our processes, and raising our standards.
Requirements:
4+ years experience with large-scale data processing, ideally with Apache Spark.
5+ years developing complex software projects with at least one of general-purpose languages (preferably Python, but not a must)
Backend and server-side development experience of complex, highly scalable systems
Experienced with machine learning concepts and frameworks.
Motivation to understand the needs of internal users, provide them with great tooling, and teach them how to use it.
Experience working with public clouds (AWS / GCP / Azure)
Fluent in written and spoken English
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7691534
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
17/04/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Required Data Engineer
Job Description:
Be responsible for designing, implementing and maintaining data pipelines from different sources into the organizational data warehouse (DWH)
Design and implement robust, scalable solutions making it easier to identify gaps and the design processes needed to solve them
Work with analysts and product managers to understand business priorities and translate requirements into data models
Collaborate with various stakeholders across the company like data engineers, analysts, data scientists, finance experts, etc.,
Collaborate with a broad forum of stakeholders, including architects and engineers, to create high quality deliverables.
Requirements:
You have 1-2 years experience in a data position
You are experienced in writing complex SQL queries
You are experienced in developing complex data pipelines
You are experienced in developing Python code
Youre an independent, self-learner who is passionate about data, understands business processes and can translate business needs into data models
You're detail-oriented with a track record of success in quantitative fields
Experience with Airflow, Great Expectations, Spark, Google or AWS Cloud Development Data Solutions would be an advantage.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7696484
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
21/04/2024
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are looking for a Software Engineer to join the Cluster team.
Why would you love this job?
As a member of the Core Platforms group, you will be responsible for the software behind the fastest NoSQL clusters on earth, supporting more than 200 million ops/sec at sub-millisecond latency with true linear scalability.
​Our ideal candidate is a strong individual that loves to work with a diverse team of bright and ambitious people. You are passionate about technology in general and specifically the challenges around cloud, performance, and distributed computing. You are a quick learner, always eager to learn and improve. You are able and willing to share your knowledge and guide other team members.
If youre all that, fun to work with, and want to make an impact while contributing to a wildly successful startup, then this is the right challenge for you.
What youll do:
Develop the next generation of ourr Cluster products and solutions.
Own and lead our Cluster features end-to-end, from design through development and deployment.
Debug, maintain, and improve the Cluster infrastructure, enhancing its ability to handle many thousands of databases with millions of requests per second.
Provide technical leadership and guidance to other team members.
Participate in various open source projects that we maintains and/or contributes to.
Work closely with team members, Product, DevOps, Support, Customer Success, and other R&D teams.
Requirements:
At least 6 years of hands-on backend development experience working on a large-scale production-grade system (preferably in PythonGo)
Excellent coding skills with a good understanding of large-scale architecture and design patterns
Experience with cloud computing and operating systems (specifically Linux)
A B.Sc. in Computer Science or Software Engineering/equivalent experience
Self-directed, ambitious, and eager to learn new things. Passionate about technology (always learning about new tech)
Extra great if you have:
Experience designing and implementing distributed systemsa BIG advantage
Experience with NoSQL databases
Experience with Python
Experience with at least one of the big cloud platforms
Have participated in an end-to-end big data and/or large scale performance challenge
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7700745
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
03/04/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
Were looking for an exceptional Data Team Lead to lead our data analytics team and transform the scraping industry. As a Head of Data, you will be a major focal point in the company, lead a team of data professionals and work closely with cross-functional teams to ensure data-driven decision-making and impactful insights.
What Youll be Doing:
Provide strong leadership and mentorship to a team of data analysts and data engineers by setting clear goals, providing regular feedback, and ensuring the teams professional growth and development
Work closely with Product, Sales and CS teams to gather needs for data insights and reports within the company
Own internal data in the company, including product and business analytics, end to end and be responsible for its delivery, infrastructure, accuracy and integrity
Work closely with the product team to lead data features of our own customer facing analytics dashboard
Lead the analysis of complex datasets to extract valuable insights, trends, patterns and anomalies that drive strategic decisions
Present findings and actionable insights to senior management and cross-functional teams
Lead the building and upgrade of existing data infrastructure to cope with performance, scalability, and growth ץ
Requirements:
4+ years of experience in data related roles, with 2+ years as a data engineer and 2+ years of experience in a leadership or managerial role.
Experience as a data analyst or as a manager of data analysts
Programming knowledge in Python or similar, strong SQL skills
Proven experience in managing and leading data teams
Excellent communication and presentation skills, with the ability to convey complex technical concepts to non-technical personas
Experience working with cloud-based data warehouses such as Snowflake, BigQuery, or Databricks
Experience designing and implementing data pipelines
Experience with working with ELT tools
Experience with SQL databases
Strong problem-solving skills and attention to detail
Excited about owning internal data analytics in the company
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7678777
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
24/03/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Were a highly collaborative, friendly, inclusive and diverse group that prizes collaboration over competition. We provide opportunities to learn new skills, mentor fellow engineers, and contribute to the direction of both the team and the products for which were responsible. We work in a distributed, remote-friendly, high-trust environment where you manage your own time and have the flexibility to balance your work and personal life. As a remote employee, you connect to your co-workers mostly via Slack and Zoom. In this setting your ability to work unsupervised, communicate asynchronously, and take initiative in maintaining lines of communication is crucial.

What You'll Do:

Develop ETL jobs to gather data from multiple sources and provide insights into various product areas

Building data warehouses where large amounts of metrics and data will be stored

Interacting with many product groups within the organization to collect key metrics via APIs, Kafka integrations or direct data access

Participation in configuring and receiving uptime alerts related to the services you control.

Keeping services up and running in a healthy state.
Requirements:
6+ years experience in programming, with proficiency in at least one object-oriented programming language, featuring strong types. Golang or Python are preferred.

Knowledge on services with at least two Cloud providers out of Aws, Azure and GCP.

Experience developing and consuming RESTful API web services.

Experience interacting with major cloud provider APIs to provision cloud infrastructure, and to monitor it. We use Amazon Web Services (AWS) cloud provider APIs the most, as well as Azure and Google Cloud (GCP).

Understanding data structures and commands for a key-value distributed caching solution, such as Redis.

Experience using RDBMS databases, and accompanying knowledge of SQL, such as Postgres.

Experience with data modeling and Extract-Transform-Load (ETL) concepts.

Bachelor's degree or equivalent work experience. Proficiency with common algorithms, data structures, code whiteboarding.

Bonus Points:

Experience with analytical databases

Understanding data structures and various APIs, for full-text search of application logs and event data in Elasticsearch.

Experience with Cassandra, CQL, and its wide-column store database.

Experience using graph structures (ie. nodes, edges), graph data, and graph databases.

Experience using a message queue. We use Kafka.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7664912
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
31/03/2024
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are looking for a Backend Software Engineer - Senior/Lead. JR245034
As a Backend Software Engineering, your job responsibilities will include:
Build new and exciting components in an ever-growing and evolving market technology to provide scale and efficiency.
Develop high-quality, production-ready code that can be used by millions of users of our cloud platform.
Make design decisions on the basis of performance, scalability, and future expansion.
Work in a Hybrid Engineering model and contribute to all phases of SDLC including design, implementation, code reviews, automation, and testing of the features.
Build efficient components/algorithms on a microservice multi-tenant SaaS cloud environment
Code review, mentoring junior engineers, and providing technical guidance to the team (depending on the seniority level).
Requirements:
5+ years of development experience as a software engineer.
Deep knowledge of object-oriented programming and other scripting languages: Java, Python, Scala C#, Go, Node.JS and C++.
Strong SQL skills and experience and experience with relational and non-relational databases e.g. (Postgress/Trino/redshift/Mongo).
Experience with developing SAAS products over public cloud infrastructure - AWS/Azure/GCP.
Proven experience designing and developing distributed systems at scale.
Proficiency in queues, locks, scheduling, event-driven architecture, and workload distribution, along with a deep understanding of relational database and non-relational databases.
A deeper understanding of software development best practices and demonstrate leadership skills.
Degree or equivalent relevant experience required. Experience will be evaluated based on the core competencies for the role (e.g. extracurricular leadership roles, military experience, volunteer roles, work experience, etc.)
Desired Skills:
Experience with Big-Data/ML and S3
Hands-on experience with Streaming technologies like Kafka
Experience with Elastic Search
Experience with Terraform, Kubernetes, Docker
Experience working in a high-paced and rapidly growing multinational organization.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7673810
סגור
שירות זה פתוח ללקוחות VIP בלבד