דרושים » הנדסה » Senior Big Data Engineer

As a Senior Big Data Engineer on our BI team, youll build and scale the data infrastructure that powers our business insights. Youll design and implement robust data pipelines to process billions of daily records, leveraging cutting-edge cloud technologies and visualization platforms to transform data into actionable intelligence.

If youre passionate about data engineering and driving business growth through insights, wed love to hear from you!

Responsibilities:
Design, Build, and operate scalable infrastructure for optimal data extraction, transformation, and loading from a wide variety of data sources, utilizing SQL, cloud migration tools, and Big Data technologies.
Work with a variety of programming languages, systems, frameworks, and cloud technologies, including Python, DBT, Airflow, AWS, Linux, Spark, and more.
Collaborate with customers and internal stakeholders to resolve data-related technical issues and support their data infrastructure and business needs.
Implement data validation, monitoring, and governance practices to ensure data accuracy, consistency, and security.

We are looking for a We are looking for a.
As a Big Data Team Lead, you will lead a core team focused on the ingestion of big data and the development of core algorithms. Your role will involve building scalable and robust solutions for processing massive geospatial datasets, including spatially-focused algorithms. You will also be responsible for developing innovative big data solutions to ensure accuracy and efficiency within a fast-paced and evolving technical ecosystem. This position requires a passionate leader with a strong background in big data technologies and a drive to innovate.
RESPONSIBILITIES:
Lead and manage a big data engineering team, focused on processing high-volume spatial-temporal data, while also engaging in hands-on technical tasks.
Collaborate daily with product managers, R&D stakeholders, and data scientists to translate requirements into robust data systems.
Prioritize and scope incoming feature requests and technical improvements to balance innovation with stability.
Maintain and evolve the teams Apache Spark-based data pipelines, including optimization and scaling.
Lead technical planning sessions, foster ownership and accountability within the team.
Drive project-level KPIs and data quality KPIs such as pipeline completion time, job reliability, data freshness metrics and data accuracy.
Manage 36 direct reports.

Were looking for a Backend Engineer to join our Foundation Group. This team builds and scales microservices in the cloud, working with Python, SQL, and NoSQL databases.

As a Backend Engineer at Placer.ai, youll take ownership of designing, developing, and rolling out services within our POI enginea core component of our platform. Youll face large-scale and high-load challenges, selecting and applying the most suitable tools and technologies to deliver reliable, high-performance solutions.
RESPONSIBILITIES:
Design and develop scalable backend systems to support POI data processing and storage, ensuring high availability and reliability.
Manage and optimize cloud-based infrastructure for handling large data volumes and high traffic, implementing infrastructure as code (IaC) practices.
Develop and maintain efficient data pipelines for the ingestion, processing, and storage of POI data, ensuring data integrity and accuracy.
Implement and maintain CI/CD pipelines to automate testing, deployment, and monitoring, ensuring smooth and rapid release cycles.
Enhance system performance and security, monitoring for bottlenecks and vulnerabilities, and ensuring compliance with data protection regulations.
Collaborate with cross-functional teams including product managers, data scientists, and frontend developers to deliver integrated solutions and participate in code reviews and technical discussions.

As a Senior DevOps Engineer, you will be responsible for designing, implementing, and optimizing our AWS-based infrastructure to support our B2B social media management platform. You will build and enhance CI/CD pipelines, improve system observability, and ensure the reliability and security of our cloud environment. Working closely with development teams, you will streamline deployments, optimize front-end resource delivery, and contribute to scaling our infrastructure. If you thrive in automation, enjoy solving complex cloud challenges, and are passionate about building efficient and resilient systems, we want to hear from you!
Responsibilities
Infrastructure Management - Design, implement, and maintain scalable, reliable, and secure cloud infrastructure on AWS to support marketing and social media solutions.
CI/CD Pipeline Development - Build, automate, and optimize CI/CD pipelines to ensure seamless and efficient deployment processes across multiple environments.
Process Automation - Develop automation strategies to improve deployment efficiency, system stability, and reduce manual intervention.
System Monitoring & Observability - Implement monitoring, logging, and alerting solutions to track system health, performance, and security.
Security Best Practices - Ensure infrastructure security and compliance, implementing best practices to protect sensitive data.
Cross-Team Collaboration - Work closely with development and product teams to integrate DevOps practices, troubleshoot issues, and support continuous improvement.
Documentation & Reporting - Maintain comprehensive documentation of system configurations, processes, and performance metrics to facilitate knowledge sharing.
Front-End Resource Delivery & CDN Optimization - Optimize CDN strategies and deployment processes for efficient front-end resource delivery.

We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Overview
Cyber Quant is a data-driven cyber risk platform that continuously analyzes an organizations security posture against real-world threat intelligence. By integrating with existing security controls, ingesting contextual business data, and automating risk modeling, the platform delivers precise, actionable insights that help organizations prioritize threats, quantify their potential business impact, reduce risk, and measure the effectiveness of mitigation strategies.
Role
Cyber Quant is looking for a Full-Stack Software Engineer with a strong backend orientation to join our growing team. Youll help design and build a complex SaaS platform that integrates with security systems, on-prem tools, and a powerful calculation engine, all while providing the best user experience. In our team, youll work closely with colleagues across Product, Cyber, DevOps, and QA to continuously deliver impact. Its a startup vibe inside a big company: fast-moving, hands-on, and full of opportunities to grow. You'll deepen your skills in architecture, scalability, and secure system design and help shape something that matters.
As a Software Development Engineer, you will:
Plan and execute high quality developments end-to-end meeting all development standards
Build various core components integrated as a whole product:
Advanced UI adjusted to various end-user UI platforms while considering SaaS experience and challenges.
Extensive and stable integration solutions to both internal and external cyber sources and systems.
Improve, validate, and innovate algorithms, calculations and analytics throughout all system components and integration points.
Work in a fast-paced and agile work environment with business-oriented delivery focus.
Communicate with team members, other technical teams and management to collect requirements, identify tasks, provide estimates and meet production deadlines
Self-study, maintain and debug all existing system components
Review and rewrite legacy code to latest technologies

We are looking for a Backend Engineer to join a growing group!
Our Stack:
Scala, Node.js, Rust
Kafka Streams / Akka Streams
Spark
Kafka
ElasticSearch, Redis
Kubernetes
AWS
What You'll Do:
End-to-end development and ownership of our products and features, from design to scalable and predictable production behavior.
Solve diverse complex problems of high scale
Collaborate with other engineers and product managers in order to improve our products
Review code, architecture, and data to identify and troubleshoot problems

We're looking for an experienced Senior Fullstack Engineer to join our AEM team. Reporting to the Manager, Software Engineering, you'll be responsible for:
Developing and maintaining high-quality, scalable backend services within a microservices architecture using Java /Spring Boot and participate in design from scratch to production
Providing architecture leadership, mentoring team members, and proactively driving technical initiatives to ensure innovation, collaboration, and n excellence within the team
Delivering high quality features for our high-scale web environment
Monitoring the performance and cost of the services in production
Staying up-to-date with industry trends and best practices to improve our technology stack and development processes

our company's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to our companys needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
In this role, with your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.
our company Cloud accelerates every organizations ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage our companys cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to our company Cloud as their trusted partner to enable growth and solve their most critical business problems.
Responsibilities
Write product or system development code.
Participate in, or lead design reviews with peers and stakeholders to decide amongst available technologies.
Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback.
Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.

our company's Algorithm Team is seeking a highly Technical data engineer to drive algorithmic data intelligence, to characterize and accelerate development processes & validation standards for complex insights from our autonomous data ecosystem. As part of the Algorithm Team, you will be responsible for understanding the deep technical needs of our algorithmic systems, translating complex data patterns into actionable insights, and building validation methods that enhance our autonomous driving capabilities. This role focuses on algorithmic data requirements analysis, complex pattern recognition, and creating intelligent data solutions that directly impact our core algorithms. The ideal candidate is a technical problem-solver with strong algorithmic thinking, a creative approach to data challenges, and the ability to dive deep into complex technical systems to extract meaningful insights.
What will your job look like:
Serve as Data expert for "brain" group of our company- the part of the software responsible for the vision, fusion, and algorithm development.
Map the data needs of the different algorithmic and functional testing teams.
Define and execute validations methods across various data flows- e.g- signals, meta data, data labels.
Contribute to delivering high-quality data products that enhance our companys autonomous driving capabilities.
Next-Generation Data Innovation - envision and develop the next generation of content and insights that can be derived from our company's big data ecosystem.

We are seeking an experienced AI Development Expert with deep technical expertise, strong system-level thinking, and a proven ability to define and implement AI-based solutions across an organization. This role involves shaping AI system architecture, selecting appropriate technologies, establishing standards, building infrastructure, and advancing innovation in areas such as Machine Learning, Natural Language Processing, and other intelligent applications.
How will you make an impact?
Write high-quality, efficient Python code, including model development, data processing scripts, and MLOps infrastructure.
Guide and advise technical teams on architecture selection, development methodologies, and MLOps practices.
Partner in defining end-to-end AI solution architecture from infrastructure to product.
Support selection and implementation of models, platforms, and advanced AI/ML tools.
Manage risks and address scalability, security, and regulatory aspects of AI solutions.
Write architecture documents, conduct technology reviews, and contribute to strategic projects.
Research and support new technologies (Generative AI, LLMs, CV, and more) according to organizational needs.
Collaborate with development, product, and data teams to optimally integrate AI solutions into existing and new products.