דרושים » תוכנה » Java Big Data Developer 2576

As a Senior Big Data Engineer, working within Mobility Group, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that powers our location analytics platform.
RESPONSIBILITIES:

Data Pipeline Architecture and Development: Design, build, and optimize robust and scalable data pipelines to process, transform, and integrate large volumes of data from various sources into our analytics platform.
Data Quality Assurance: Implement data validation, cleansing, and enrichment techniques to ensure high-quality and consistent data across the platform.
Performance Optimization: Identify performance bottlenecks and optimize data processing and storage mechanisms to enhance overall system performance and reduce latency.
Cloud Infrastructure: Work extensively with cloud-based technologies (GCP and AWS), to design and manage scalable data infrastructure.
Collaboration: Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Software Engineers to understand requirements and deliver solutions that meet business needs.
Data Governance: Implement and enforce data governance practices, ensuring compliance with relevant regulations and best practices related to data privacy and security.
Monitoring and Maintenance: Monitor the health and performance of data pipelines, troubleshoot issues, and ensure high availability of data infrastructure.
Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and growth within the team.

As a Senior Software Engineer specializing in JVM-based frameworks, you'll serve as a core contributor, owning and maintaining critical parts of Data engineering ecosystem. This role sits at the intersection of high-performance database engineering and developer experience, where you'll craft tools that enable Data Engineers to harness incredible speed and scale.

We are looking for a highly motivated backend software engineer specializing in creating high-scale, distributed backend systems.

You must demonstrate strong software engineering skills, excellent interpersonal communication, extreme ownership, and the ability to accept and give meaningful technical feedback.

You will be responsible for designing architecture, writing correct, robust code, maintaining and improving existing functionality, and shipping new features.

You will work as part of a Scrum-Agile cross-functional team and collaborate with front-end engineers, quality engineers, product managers, and more.

The platform you help us build will scale novel functionality to millions of Plus users worldwide.

Our team strives to set the bar for real-time, high-scale, mission-critical trading systems. We want to work with people who are excited by this goal and have the talent to deliver on it.

What Youll Do - Responsibilities

Design and build scalable, high-availability mission-critical systems and APIs
Drive the migration of large-scale, distributed trading services towards cloud-native microservices
Solve problems using distributed, asynchronous messaging
Tackle technical challenges - performance, fault-tolerance, security, and live production issues
Work closely with product, DevOps\SRE, and infrastructure teams - we practice full-cycle development where developers own and operate what they build.
Mentor Jr engineers as a Senior member of the team

Required Java Software Engineer
Description
A hyper-growth company, and our development team is hiring talented and experienced Backend Engineers to design and develop end-to-end major features and new services.
Responsibilities:
Work closely with the founding team and product managers.
Support the availability of our service, participate in the on-call shifts.
Innovate, Lear, and Teach.

Do you thrive on solving complex problems and want to make a real impact?
we are looking for a Backend Java engineer responsible for managing the interchange of data between the server and the users. In this senior role, you will play a pivotal role in our optimization engine, driving the core routing intelligence of our platform.
If you like a good challenge and are looking for a place to grow professionally, we are the place for you! Join the amazing process of developing a robust and scalable solution for the last mile and on-demand world.
Responsibilities
Optimization Engine Leader: Serve as a central pillar for our optimization engine, collaborating closely with the product team to shape the journey from client requirements to server-side reality.
Architecture Ownership: Lead and maneuver the optimization engine architecture to ensure maximum efficiency and scalability.
Complex Problem Solving: Solve complex puzzles by investigating discrepancies between system design and real-world results, proving hypotheses, and taking actionable steps to resolve them.
Backend Development: Define and maintain the server end-to-end flow, develop server-side logic, and ensure high performance, scalability, maintainability, and responsiveness to frontend requests.

we are looking for a Senior Data Engineer.
ou'll be actively engaged in the most fascinating and demanding projects for our clients. Handling high-scale operations, heavy traffic, stringent SLAs, and massive data volumes is just the starting point. Our leadership in the realms of Big Data, Streaming Data, and Complex Event Processing (CEP) stems from our adept use of cutting-edge, optimal technologies.
Responsibilities:
Apply software-engineering methods and best practices (Medallion Architecture) in Data Lake management, using tools like DBT.
Develop Data pipelines to ingest and transform data.
Manage and enhance orchestrated pipelines across company
Data Modeling: Developing data models to ensure efficient storage, retrieval, and processing of data, often involving schema design for NoSQL databases, data lakes, and data warehouses. This will also include catalogs of data.
Scalability: Ensuring that the big data architecture can scale horizontally to handle large volumes of data and high traffic loads.
Data Security: Implementing security measures to protect sensitive data, including encryption, access controls, and data masking.
Data Governance: Establishing data governance policies to ensure data quality, compliance with regulations, and data lineage.

We empower enterprises and service providers with cutting-edge Storage platforms that redefine performance, reliability, and cyber resilience at scale. Were looking for a talented and motivated JAVA Developer with strong software engineering fundamentals and a passion for learning complex systems. Youll take part in the design and development of our Management group and work on a high-performance, multi-threaded, clustered, server-side product.
Responsibilities:

* Design and implement JAVA backend components according to product requirements.
* Develop new features and improve existing code (maintenance, bug fixes, refactoring, and performance enhancements).
* Write unit tests and perform integration tests.
* Ensure high standards of code quality, performance, reliability, and engineering best practices.
* Work in an Agile development environment.
* Collaborate with the team: participate in design discussions, code reviews, and mentoring/supporting teammates.

We're a leading force in the ad tech industry, revolutionizing how brands connect with their audiences. Our platform processes billions of ad impressions daily, generating massive datasets that drive our core business.

We thrive on innovation and seek a Senior Data Infra Engineer to help us build and scale the data infrastructure that powers our insights and analytics.
This is a unique opportunity to work with cutting-edge technologies and make a direct impact on our products.

What will you do?
As a Senior Data Infra Engineer, you'll be a key part of our data platform team, responsible for designing, building, and maintaining robust and scalable data pipelines. You'll work closely with data scientists, analysts, and server side engineers to ensure our data is reliable, accessible, and ready for analysis. Your expertise will be crucial in expanding our data warehouse and data lake capabilities, enabling us to deliver next-generation ad tech solutions.

Your mission will be to:

Develop and Optimize Data Pipelines: Design, build, and maintain ETL/ELT pipelines using Apache Spark to ingest, process, and transform large-scale datasets from various sources.
Manage Cloud Infrastructure: Architect and manage our data infrastructure primarily on Google Cloud Platform (GCP) or Amazon Web Services (AWS). This includes services like BigQuery, S3, GCS, EMR, and AirFlow.
Enhance Data Storage: Improve and manage our data warehouse and data lake solutions, ensuring data quality, consistency, and accessibility for business intelligence and machine learning applications.
Collaborate and Innovate: Partner with cross-functional teams to understand data needs and implement solutions that support new product features and business initiatives.
Ensure Data Integrity: Implement monitoring, alerting, and logging systems to maintain data pipeline health and ensure data accuracy.

Were looking for a sharp and driven Data Analyst to join our fast - paced Data Labs team. As part of a high-performing group of analysts, youll handle complex, custom requests from some of the biggest names in the market, turning raw data into strategic, ad hoc insights. The work is intense and constantly evolving - it requires strong analytical skills and the ability to work independently under pressure. Youll need to be curious, adaptable, and willing to dive deep to find answers where others might stop. If you thrive in a demanding environment and are excited by the opportunity to make a real impact, we want you on our team.

What does the day to day of a Big Data Analyst Customer Facing (Data Labs) look like:

Building custom-made reports end to end - from meeting with the client and understanding their needs, to writing the code and setting up the report for ongoing delivery.
Apply your expertise in quantitative analysis and data mining to turn data into insights.
Conduct research and develop tools which will help answer client's business. questions by using raw data sets and algorithms.
Partner with Engineering teams to establish an infrastructure to scale solutions.
Partner with Advisory Services team of Consultants to answer strategic business questions and deliver custom data products seamlessly

We are seeking a highly skilled and versatile Senior Data Infrastructure Engineer to join our team and participate in the design, implementation and maintainance of cutting-edge Data Platforms and Big Data solutions. This position allows you to have the unique opportunity to significantly impact intelligence processes, contribute to counter-terrorism efforts by leveraging advanced Big Data technologies.
This role combines expertise in Big Data Infrastructure, Big Data Engineering, architecture and support of critical operations and intelligence processes.
עוד על התפקיד
Design, install, maintain and upgrade Big Data technologies.
Monitor and optimize system performance, identifying areas for improvement and implementing solutions.
Provide technical support to internal teams and end-users, ensuring seamless operations.
Conduct POCs and recommend adoption of new technologies and tools in the Big Data domain.
Develop automation solutions for infrastructure management, empowering teams to operate efficiently.