דרושים » תוכנה » Senior Data Engineer

משרות על המפה
 
בדיקת קורות חיים
אבחון און ליין
VIP
הפוך ללקוח VIP
רגע, משהו חסר!
נשאר לך להשלים רק עוד פרט אחד:
 
שירות זה פתוח ללקוחות VIP בלבד
AllJObs VIP
משרה זו סומנה ע"י המעסיק כלא אקטואלית יותר
שם חברה חסוי
מיקום המשרה: תל אביב יפו
סוג משרה: משרה מלאה
משרות דומות שיכולות לעניין אותך
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
16/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Required Senior Data Engineering
We are looking for a talented and experienced Data Engineer to join our data engineering team. In this role, you will be responsible for designing, implementing, and maintaining our data pipelines and infrastructure. You will collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure the availability, accessibility, and quality of our data assets. Your expertise in data processing, database technologies, and ETL processes will be essential in enabling effective data utilization and analysis.
Responsibilities:
Design, develop, and maintain efficient and scalable data pipelines that extract, transform, and load data from various sources into target systems.
Monitor and optimize data pipelines for performance, reliability, and data quality.
Implement and manage data storage solutions, including relational databases, data warehouses, and NoSQL databases.
Implement data partitioning, indexing, and compression strategies for improved performance and scalability.
Identify and resolve data quality issues, including data cleansing, standardization, and validation.
Identify and implement performance optimization techniques to enhance data processing speed, query performance, and system scalability.
Monitor and analyze data infrastructure and pipeline performance, identifying bottlenecks and implementing optimizations.
Stay updated on emerging technologies and trends in data engineering, proactively identifying opportunities for innovation and improvement.
Requirements:
Relevant Bachelor's degree preferably CS, Engineering/ Information Systems, or other equivalent Software Engineering background.
5+ years of experience as a Data engineer.
Strong SQL abilities and hands-on experience with SQL and no-SQL DBs, performing analysis and performance optimizations.
Hands-on experience in Python or equivalent programming language
Experience with data warehouse solutions (like Bigquery/ Redshift/ Snowflake or others)
Experience with data modeling, data catalog concepts, data formats, data pipelines/ETL design, implementation, and maintenance.
Experience with AWS/GCP cloud services such as GCS/S3, Lambda/Cloud Function, EMR/Dataproc, Glue/Dataflow, and Athena.
Experience with Airflow and DBT (advantage).
Experience with MLOps (advantage).
Experience with development practices Agile, CI/CD, TDD - Advantage.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7723424
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
09/06/2024
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are looking for an experienced Senior Data Engineer to join our 'Data & AI' group. As a key member of our team, you will play a crucial role in designing and building data models, developing infrastructure, and optimizing data processes to support our data analysis, data science and engineering teams. You will collaborate with various stakeholders to ensure efficient data ingestion, processing, and analysis, contributing to the overall success of our data-driven initiatives.
Key Responsibilities:
Design and build robust data models and infrastructure to support data science and engineering teams.
Develop and optimize data processes, including ETL/ELT pipelines, for efficient data ingestion and processing.
Identify and understand business processes to derive actionable insights from the data.
Collaborate with BI analysts to create comprehensive reports and dashboards.
Implement and maintain scalable data solutions in a high-volume production environment.
Utilize modern technologies such as M3DB, Open-Search, Grafana, etc., for data processing and analysis.
Lead design initiatives for new products and contribute to best practices.
Work closely with cloud providers like AWS for data storage, computation, and orchestration.
Stay updated with advancements in data engineering, big data, and cloud technologies.
Requirements:
Bachelor's degree in computer science, engineering, or a related field.
5+ years of hands-on experience in data engineering and BI development.
Proficiency in SQL and Python for data manipulation and pipeline development.
Experience with complex ETL/ELT processes and big data technologies
Experience with Airflow.
Strong analytical skills and attention to detail
Excellent communication and collaboration abilities.
Preferred Qualifications:
Experience with machine learning algorithms and AI implementation.
Previous work with distributed systems, real-time analytics, and data visualization tools.
Familiarity with the AWS cloud platform and big data technologies.
Experience with Spark, Kafka, Elasticsearch, DynamoDB, and K8s.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7752621
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
13/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Data Engineer.
In your role as a Data Engineer, you'll be actively engaged in the most fascinating and demanding projects for our clients. Handling high-scale operations, heavy traffic, stringent SLAs, and massive data volumes is just the starting point. Our leadership in the realms of Big Data, Streaming Data, and Complex Event Processing (CEP) stems from our adept use of cutting-edge, optimal technologies.
Responsibilities:
Apply software-engineering methods and best practices (Medallion Architecture) in Data Lake management.
Develop Data pipelines to provide ingest and transformation of data.
Manage and enhance orchestrated pipelines across company
Data Modeling: Developing data models to ensure efficient storage, retrieval, and processing of data, often involving schema design for NoSQL databases, data lakes, and data warehouses.
Scalability: Ensuring that the big data architecture can scale horizontally to handle large volumes of data and high traffic loads.
Data Security: Implementing security measures to protect sensitive data, including encryption, access controls, and data masking.
Data Governance: Establishing data governance policies to ensure data quality, compliance with regulations, and data lineage.
Requirements:
5 years of experience in Python (+Java / Scala)
Experience in NoSQL and data storage (e.g. Elasticm, Redis, MongoDB, CouchBase, BigQuery, Snowflake, Databricks)
Experience in data formats (Parquet, Avro, ORC)
Experience in Big Data Technologies (Spark, MapReduce )
Experience in streaming (Spark Streaming, Flink, Kafka Streams, Beam, etc.)
Experience in messaging (Kafka, RabbitMQ, etc.)
Experience with Machine Learning (Spark ML, TensorFlow, etc.) - Plus
Experience in cloud platforms (AWS, GCP)
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7719953
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
20/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Were looking for brilliant data engineers to join our rapidly growing team.
You will join a team consisting of senior software and data engineers that drive our data platform from data acquisition, to processing and enrichment and all the way to business insights.
You will join an early stage team and company and will have a major impact on the decisions and architecture of our various products.
Responsibilities:
Design and build data acquisition pipelines that acquire, clean, and structure large datasets to form the basis of our data platform and IP
Design and build data pipelines integrating many different data sources and forms
Define architecture, evaluate tools and open source projects to use within our environment
Develop and maintain features in production to serve our customers
Collaborate with product managers, data scientists, data analysts and full-stack engineers to deliver our product to top tier retail customers
Take a leading part in the development of our enterprise-grade technology platform and ecosystem
Harmonize and clean large datasets from different sources.
Requirements:
At least 6 years of experience in software engineering in Python or an equivalent language
At least 3 years of experience with data engineering products from early-stage concept to production rollouts
Experience with cloud platforms (GCP, AWS, Azure), working on production payloads at large scale and complexity
Hands-on experience with data pipeline building and tools (Luigi, Airflow etc), specifically on cloud infrastructure
Advantage: Hands-on experience with relevant data analysis tools (Jupyter notebooks, Anaconda etc)
Advantage: Hands-on experience with data science tools, packages, and frameworks
Advantage: Hands-on experience with ETL Flows
Advantage: Hands-on experience with Docker / Kubernetes.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7728201
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
7 ימים
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are seeking a Big Data Engineer to join our team.
In this role, you will play a crucial role in designing, building, and maintaining our query engine. You will play a crucial role in managing large volumes of data, optimizing data pipelines, optimizing data query, developing complex analytics capabilities on top of the data, and ensuring the reliability and scalability of our data infrastructure.
Responsibilities:
Develop our ETL and query engines using Java / Spring Boot / Scala / Zio
Deliver high quality features for our high-scale web environment
Participate in design from scratch to production
Monitor the performance and cost of the services in production
Stay up-to-date with industry trends and best practices to continuously improve our technology stack and development processes
Integrate with other team members (backend/frontend/product/UX).
Requirements:
5+ years of proven backend development experience using Scala, Java, and Spring Boot
5+ years of experience working in a microservices environment, including AWS, Kubernetes, RabbitMQ, SQS, Terraform, Helm, and Tilt
High proficiency in various data stores such as MongoDB, Elasticsearch, PostgreSQL, Snowflake, and Redshift
An enthusiastic self-learner who can confidently embrace new technologies, conduct research to discover innovative solutions, and successfully deliver results
Demonstrated excellent problem-solving skills and meticulous attention to detail.
Strong communication and collaboration skills
Ability to adapt quickly and effectively manage context switches.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7757074
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
לפני 17 שעות
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Principal Backend Engineer to join our Cortex XDR team and help us to prevent, detect and respond to all runs on an integrated endpoint, network and cloud data reduce the noise and focus on real threats.
More information about the Cortex XDR product can be found here.
Your Impact:
You will be a part of a group with the mentality and independence of a startup, supported by the power of a successful corporation - You will design and build an infrastructure that supports billions of events per second, storing, processing and making them accessible and visible to the user while collaborating with the industrys leading cyber products
You will be responsible for the complete software development life cycle including requirement analysis, design, development, deployment, and support - You will write clean, testable, readable, fast and maintainable code that is efficient and scalable
Requirements:
BSc in Computer Science or equivalent knowledge or equivalent military experience required
5+ years of software engineering experience - Must
Experience in distributed cloud products
Experienced with a variety of database technologies (Mysql / Cassandra / Google BigQuery Amazon Redshift / ElasticSearch)
Experience in designing, building and maintaining a scalable server-side application
Experience in Go / Python - an advantage
Experience with GCP - advantage
Experience with Kubernetes/Docker - advantage
Knowledge of the cyber field - advantage
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7766005
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
פורסם ע"י המעסיק
09/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are Tailor Brands . We built a platform that builds businesses. From launching and managing to growing a business, Tailor Brands is the all-in-one solution that empowers any business owner. Our platform services over 40 million small businesses Our "Guidance Engine" assesses each new business introduced to our platform and devises a tailored plan that allows you to manage all your business needs from a single dashboard. Through our business-building platform, we’re turning the process of starting, managing, and growing a business into a better experience; we’re simplifying the business journey. At Tailor Brands, we believe in more than just handing you another tool; we are dedicated to teaching you the art of building a business About the Role As a Senior Platform Engineer, your work will have a direct impact on development processes across the entire R&D organization. You will help lead our Infrastructure, SRE, CI/CD, Security, and Scale/Performance efforts. You will take a leading role in defining and designing these systems, all to enable our Fullstack and Data teams to be as independent and successful as possible. At Tailor Brands, the Platform team doesn't manage all of our services on their own – they build the tools and guidance so our Development teams can own them end-to-end.
* Take an active role in the senior platform engineer engineering team that focuses on all aspects of CI/CD infrastructure, GitOps full automation, and operational metrics to ensure the highest productivity for our Cloud engineering infrastructure
* Lead the design and delivery of software and infrastructure to improve the reliability, scalability, and efficiency of our services.
* Design, develop, and maintain our core platform and CI/CD infrastructure and our development environments
* Manage cloud security principles and define best practices
* Build, configure, and tune highly available and fault-tolerant Container Clusters and K8s infrastructures
* Take an active role in defining the team’s roadmap
* Develop automation to support our orchestration and application deployment
Requirements:
* 4+ years of work experience as a senior platform engineer hands-on Engineer in a production environment
* Understanding of Development and build processes, CI & CD concepts, and tools
* Experience with any of the major cloud providers: Azure, AWS, Google Cloud
* Experience with Kubernetes or other container orchestration tooling Nice to have
* IaC experience
* Experience in a fully CD environment
* Programming experience Nice to know
* We are located in Rothschild, Tel Aviv
* Our hybrid model includes four days in the office and one day at home
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7635268
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
7 ימים
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
As a Software Engineer - Frontend on a feature team, you'll be responsible for building an intuitive, responsive product.
Your work will help thousands of customers to monitor the health and performance of their systems, no matter the scale.
In this capacity, youll use tools like React and Typescript to help streamline the flow of data from platform to user, enable seamless pivots from one view to the next, and build a powerful yet easy-to-use platform.
You will work on complex frontend challenges for thousands of customers with huge sets of data and work on exciting scalability and performance challenges.
Our users are also developers so you will feel close to the product and have an impact on the development world.
You will be part of a front-end community of 200+ passionate frontend engineers and you will be surrounded by experts. Join us to build the next generation of high-scale, data-powered features for our customers.
What Youll Do:
Work closely with backend engineers, product managers and designers to inform/refine/validate design concepts
Break down complex features into distributable engineering tasks and rollout plans
Design and deliver features that have direct impact on thousands of users
Experiment with and advocate for new systems, design patterns, and tooling
Participate in hackathons, sync with other Front end engineers at the monthly demos meeting and yearly Front End summit
Use and contribute to a best-in-class in-house design system
Own meaningful parts of our service, improve performance and address scalability limits
Work in a fast-paced, high-growth environment that values diversity of talent, excellence of product, and exciting engineering challenges at scale
Requirements:
You have been designing and engineering UIs for several years
Youre a master of the Javascript ecosystem and youre aware of the latest trends with frontend technologies
You know how to use design patterns to create simple and reusable components for complex UIs
You are familiar with data structures and algorithms, profiling and optimization
You value code simplicity, performance and details
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7757404
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
20/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Fullstack Engineer to join our in-house research infrastructure team and play a pivotal role in contributing to the companys ongoing success, Come join us.
What you will do:
The teams mission is to build the ultimate platform for quantitative finance research and Real Time production trading. Our pipelines process huge amounts of data from various sources, and you will take part in developing new workflows using state of the art technology to gain insights and optimize across all products.
Your Impact:
The workflow you will develop will be used by the entire company.
Conceiving innovative and novel ideas to visualize multi-dimensional data across a variety of client applications.
Working with quantitative researchers and production traders to deliver a high-quality UX/UI experience
End-to-end ownership POC, design, development cycles, deployment, and testing.
Creative thinking using state-of-the-art tech stack.
Requirements:
BSc in Computer Science or equivalent software engineering fundamentals (Autodidact, Military experience)
Can-do mentality, intellectual curiosity, self-motivation, and ability to communicate within and across teams.
7+ years of professional experience as a software engineer with significant Front End and Back End experience.
Strong coding skills in JS and Python.
A passion for creating a slick UX.
A deep understanding of production systems and architecture.
Experience with UI testing frameworks and CI pipelines
Preferred Qualifications:
A passion for capital markets.
Prior experience in quantitative finance.
Prior experience in C++, C#
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7727418
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
26/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
we are on the lookout for a Director Of Infrastructure, one who lives and breathes DevOps & security principles and methodologies, with a developer and business objective mindset.
Role:
Lead, support, and mentor a group of four teams: DevOps, DevSecOps, SRE, and Infra. Currently overseeing 15 engineers, directly managing the team leads of the DevOps and DevSecOps teams, and providing both technical guidance and management leadership
Build a new Site Reliability Engineering (SRE) team that will be in charge of the health of the production environment. This team will be a central part of our production operations strategy, working hand in hand with our Operations team, DevOps, and R&D.
Build an R&D infrastructure team to develop and support applicative infrastructure components such as databases, web servers, logging mechanisms, and any other low-level infrastructure required by the R&D team to achieve their objectives.
Plan the team's roadmap to meet our business objective
Work closely with tech leads to define, design and implement infrastructure needs
Responsible for all DevOps and security areas: infrastructure and cloud environments, CI/CD, observability, SAST, SCA, SSDLC and Cloud Security
Lead a developer/development experience culture make developers more efficient and productive by addressing their pain points, ensuring the reusability of tools among all development teams, maintaining consistent standards for testing and monitoring, and continuously improving developer tools.
Accountable for the architecture and technical leadership of the complete DevOps infrastructure and stack
Implement and maintain security best practices and standards, leading the security issue remediation process as part of the integration with Mastercard
Oversee DevOps tasks, perform code reviews and provide development assistance
Optimize operation efforts and adopt new tools
Design, implement, and continually improve everything the team does to accelerate performance and efficiency
Serve as an escalation point for the team and other stakeholders within the organization
Collaborate closely with stakeholders in designing, implementing, and troubleshooting production services
Recruit new candidates for the team and retain talents
Requirements:
2+ years of leadership experience managing multiple teams in a mid-sized or larger company with over 100+ R&D employees
5+ years of hands-on experience as a DevOps Engineer or as a Software Developer, with proven expertise in cloud infrastructure and systems at scale.
Proven experience with container technology and familiarity with container orchestration and toolchain, such as Kubernetes, Helm, ArgoCD, Docker, etc.
Experience in running and maintaining large-scale production systems over AWS stack
In-depth knowledge of cloud security best practices
Experience with Infrastructure-as-Code toolchains and frameworks, such as Terraform, CloudFormation, etc.
Experience with CI/CD tools, such as GitHub Actions, Jenkins
Experience in scripting and programming, such as Python, Bash, Go, Groovy
Experience with observability tools, such as Prometheus, Grafana, ELK/OpenSearch and with a strong analysis skills
Familiarity with the software development life cycle and secure coding practices to safeguard the integrity and security of our products
Strong communications skills
Multi-tasker and a team player who takes ownership and knows how to prioritize efficiently
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7735599
סגור
שירות זה פתוח ללקוחות VIP בלבד