דרושים » הנדסה » Big Data Engineer - 2528

We are looking for a Big Data Software Engineer to join our growing team. In this role, you will be responsible to design and development of our big data processing engine.
Responsibilities:
Design and development of high-quality big data processing engineer
Identify and proactively address potential product risks and challenges and ensuring success.
Work closely with stakeholders to transform requirements into technical specifications.
Ensure that the code is consistent with industry coding standards and best practices.
Take a deep dive into the technical details and provide expert advice and solutions.

Required Big Data Engineering Lead
As a Big Data Engineering Lead within our Data & AI Department, you will play a pivotal role in designing, implementing, and optimizing Data & GenAI solutions that empower innovation and enable intelligent decision-making across our organization. In this role, you will lead the design of our future-proof data platform, ensuring it is scalable, open, extensible, high-performing, private & secure. You will also play a pivotal role in designing, implementing, and optimizing GenAI solutions related with data domain that drive innovation and enable intelligent decision-making. You will partner with engineering & business stakeholders to understand their data needs and deliver technological solutions that drive business value, leveraging cutting-edge AI technologies and robust data strategies. This is an opportunity to shape the future of data and AI and make a lasting impact.
As a Big Data Engineering Lead you will...
Lead the design and development of our petabyte-scale Lakehouse and modern data platform, drive architectural decisions, and provide technical leadership to ensure it meets scalability, performance, privacy, and security requirements.
Collaborate closely with top-notch engineers in implementation efforts to ensure alignment with architectural vision, tackle tough problems, and deliver creative solutions.
Provide hands-on expertise through platform development and conduct architecture proof-of-concepts to validate and recommend tools, technologies, and design decisions.
Promote the adoption and utilization of the data platform by collaborating with stakeholders to identify impactful use cases, developing enablement resources, and ensuring the platform delivers measurable business value.
Evaluate and recommend tools and technologies to support & proliferate Data & AI-driven decision-making and make data production and consumption widespread.

DRS RADA is a global pioneer of RADAR systems for active military protection, counter-drone applications, critical infrastructure protection, and border surveillance. Join Our Team as a Senior Data Engineer at DRS RADA Technologies! Job Summary: We are seeking an experienced Senior Data Engineer to join our data engineering team. In this role, you will play a crucial part in designing, developing, and maintaining scalable data pipelines and infrastructure to support our AI department. This is an opportunity to work with cutting-edge technologies in a fast-paced production environment, driving impactful, data-driven solutions for the business. Key Responsibilities:
* Design, develop, and optimize ETL/ELT pipelines for large-scale data processing.
* Work with a modern data stack, including Databricks (Spark, SQL), Apache Airflow Azure services
* Troubleshoot and optimize queries and jobs for performance improvements.
* Implement best practices for data governance, security, and monitoring.
* Stay updated with industry trends and emerging technologies in data engineering.

As a Team Lead, you will have the opportunity to significantly impact intelligence processes and contribute to counter-terrorism efforts by designing and implementing cutting-edge big data solutions on various platforms.
Responsibilities
Manage and lead a team of Big Data engineer.
Design and implement advanced infrastructure solutions using Hadoop Ecosystem.
Work closely with other departments within the organization to understand their needs and develop tailored solutions.
Analyze user requirements and recommend new tools and technologies in the field of Big Data.
Develop self-service solutions for managing and creating infrastructure under team's responsibility.
Manage large-scale projects while meeting deadlines and targets.

We seek an experienced Software Engineer with a strong background to become an integral member of our Data-Core team, tasked with the mission of processing, structuring, and analyzing hundreds of millions of data sources.
Your role will be pivotal in creating a unified, up-to-date, and accurate utilities map, services, and applications for accelerating our mapping operations. Your contributions will directly impact our core product's success.
Responsibilities:
Collaborate with cross-functional teams to design, build, and maintain data processing pipelines while contributing to our common codebase.
Contribute to designing and implementing data architecture, ensuring effective data storage and retrieval.
Develop and optimize complex Python-based applications and services to allow more efficient data processing and orchestration, enhancing the quality and accuracy of our datasets.
Implement geospatial data processing techniques and contribute to the creation of our unified utilities map, enhancing the product's geospatial features.
Drive the scalability and performance optimization of data systems, addressing infrastructure challenges as data volume and complexity grow.
Create and manage data infrastructure components, including ETL workflows, data warehouses and databases, supporting seamless data flow and accessibility.
Design and implement CI/CD processes for data processing, model training, releasing, testing and monitoring, ensuring robustness and consistency.

We are interested in welcoming a Big Data Expert to our diligent Big Data team and take overall responsibility for developing, executing, and maintaining strategy and workflow while anticipating possible consequences, changes, and trends.
We believe that the perfect candidate possesses excellent leadership, communication, and social skills to build an effective and motivated team, utilizing the full potential of the skills and expertise of each member.
Responsibilities and tasks include:
Implementation, tuning and ongoing administration of Big Data infrastructure on Hadoop cluster and other NoSQL platforms
Managing end-to-end availability, monitoring performance, and planning capacity using a variety of open source and developed toolsets
Research and perfect best practices to support implementation of new features and solutions in Big Data and NoSQL space
Perform all levels of DBA support (e.g., plan and coordinate patching/upgrades)
Manage database backup and recovery
Troubleshoot and resolve database/application issues in a timely manner, tuning performance at the DB and SQL levels.

we are looking for a senior developer to join a new big-data analytics team as part of our company's data platform.
The autonomous vehicle project generates huge amounts of data and our challenge is to enable it for usage by the entire organization (Deep Learning /Machine Learning Developers, Product Managers, Analysts, and more.)
We are using a top-notch tech stack to solve problems multiple databases and big data frameworks, data streaming, AWS infrastructure on a large scale, and many more.
What will your job look like:
Work on a large-scale system from early stages and watch it evolve
Take part in the design & development of a multi-service cloud-based big data platform
Evaluate various optional technologies and take part in the decision-making
Own key features and services.

We are looking for a Big Data Software Engineer to join our growing team. In this role, you will be responsible to design and development of our big data processing engine.
Responsibilities:
Design and development of high-quality big data processing engineer
Identify and proactively address potential product risks and challenges and ensuring success
Work closely with stakeholders to transform requirements into technical specifications
Ensure that the code is consistent with industry coding standards and best practices
Take a deep dive into the technical details and provide expert advice and solutions

We are looking for a creative Advanced Development Engineer to join the Software Architecture Team. In this role, you will shape the future of data centers, management and monitoring solutions. You will dive into emerging technologies, define and prove concepts, and identify or create the necessary frameworks. Your responsibilities will include defining and implementing large-scale telemetry pipelines, ensuring data integrity, and designing simulation solutions and other innovative technologies. You will also design and optimize data architecture to support robust and scalable systems. As part of the architecture team, you will influence cross-company solutions and have the opportunity to participate in open source projects and communities.

What you'll be doing:

Discover and assess emerging technologies and innovations to ensure they align with our technological goals and business value.

Develop and integrate software services into the Data Center life-cycle.

Incorporate new data sources to consistently expand the capabilities of the centralized Data Lake.

Build high-performance ETL pipelines with advanced data integrity control.

Collaborate with various teams to define and implement solutions for their business requirements.

Work closely with architects and data scientists to shape solutions and meet business needs.

Contribute to defining the architecture for next-generation monitoring and analytics solutions for large-scale Data Centers.

Expand the capabilities of existing solutions and Open Source projects, and contribute to the community.

We are looking for a passionate and experienced Software Engineer to join our Networking Group.
In this role, you will play a key part in developing our cloud-based, proprietary networking and security management solutions.
You will also design and implement highly scalable processes for gathering and analyzing real-time network statistics, events, and large-scale data.
Responsibilities:
End-to-end backend development: from processing large-scale data to designing efficient microservices.
Develop and enhance high-performance, scalable services.
Improve the reliability, security, and scalability of existing infrastructure.
Work closely with cross-functional teams including Product, Data, Security, and UX.
Research and adopt new technologies to improve our products.