דרושים » ניהול ביניים » Big Data Team Lead - 2486

We are seeking an experience and skilled Big Data Infrastructure Admin with passion for data.
Responsibilities
Monitor, install and upgrade Big Data technologies based mainly on Hadoop Ecosystem including hdfs, yarn, spark, trino, ect.
Providing technical support and assistance to internal teams and end-users.
Monitoring and maintaining system performance and making recommendations for improvements.
Design and implement advanced infrastructure solutions using Hadoop Ecosystem.
Analyze user requirements, test and recommend new tools and technologies in the field of Big Data.
Develop self-service solutions for managing and creating infrastructure under your team's responsibility.

Required Big Data Engineering Lead
As a Big Data Engineering Lead within our Data & AI Department, you will play a pivotal role in designing, implementing, and optimizing Data & GenAI solutions that empower innovation and enable intelligent decision-making across our organization. In this role, you will lead the design of our future-proof data platform, ensuring it is scalable, open, extensible, high-performing, private & secure. You will also play a pivotal role in designing, implementing, and optimizing GenAI solutions related with data domain that drive innovation and enable intelligent decision-making. You will partner with engineering & business stakeholders to understand their data needs and deliver technological solutions that drive business value, leveraging cutting-edge AI technologies and robust data strategies. This is an opportunity to shape the future of data and AI and make a lasting impact.
As a Big Data Engineering Lead you will...
Lead the design and development of our petabyte-scale Lakehouse and modern data platform, drive architectural decisions, and provide technical leadership to ensure it meets scalability, performance, privacy, and security requirements.
Collaborate closely with top-notch engineers in implementation efforts to ensure alignment with architectural vision, tackle tough problems, and deliver creative solutions.
Provide hands-on expertise through platform development and conduct architecture proof-of-concepts to validate and recommend tools, technologies, and design decisions.
Promote the adoption and utilization of the data platform by collaborating with stakeholders to identify impactful use cases, developing enablement resources, and ensuring the platform delivers measurable business value.
Evaluate and recommend tools and technologies to support & proliferate Data & AI-driven decision-making and make data production and consumption widespread.

We are interested in welcoming a Big Data Expert to our diligent Big Data team and take overall responsibility for developing, executing, and maintaining strategy and workflow while anticipating possible consequences, changes, and trends.
We believe that the perfect candidate possesses excellent leadership, communication, and social skills to build an effective and motivated team, utilizing the full potential of the skills and expertise of each member.
Responsibilities and tasks include:
Implementation, tuning and ongoing administration of Big Data infrastructure on Hadoop cluster and other NoSQL platforms
Managing end-to-end availability, monitoring performance, and planning capacity using a variety of open source and developed toolsets
Research and perfect best practices to support implementation of new features and solutions in Big Data and NoSQL space
Perform all levels of DBA support (e.g., plan and coordinate patching/upgrades)
Manage database backup and recovery
Troubleshoot and resolve database/application issues in a timely manner, tuning performance at the DB and SQL levels.

We are seeking for a Big Data Engineer with data architect skills to join our team and contribute to our advanced and challenging technological environment.
In this role, you will collaborate with diverse professionals working on projects that involve planning and designing processes in large and complex systems.
You will develop infrastructure components for pipeline in the big data environment using airflow as a data flow manager tool.
You will advise and support data engineers and developers in designing architecture and implementing solutions on top of big data platforms using various technologies.

We are building a modern remote access solution that simplifies and improves the way businesses secure access to their cloud, SaaS, and on-prem resources. We are backed by leading investors such as BOND, WndrCo, 8VC, Green Bay Ventures, SignalFire, and Dropbox founders Drew Houston and Arash Ferdowsi. Our investors share our belief that in a world where workforces are becoming increasingly distributed, it is critical to be able to effectively secure access to apps, data, and environments.As part of our company culture, our belief in putting the customer first permeates our thinking in everything from our customer communications to the design process behind the product itself. If you take pride in creating experiences with the customer firmly at the center of the picture, we'd love to work with you.
The Role:
We are seeking a data engineering team lead to build, grow and scale our data pipeline and infrastructure, while building and managing a top notch team. You must be an experienced software engineering leader who has on hands experience with various Big Data solutions and warehouses. You must have a proven track record of managing and scaling teams within a rapidly growing company.ResponsibilitiesBuilding and scaling our data injestion pipline. We are ingestig hunderds of GB of data a day and growing fastBuilding our data analysis and export infrastructureRecruiting and mentoring new team members,
Working closely with product team and other engineering teams.
Benefits:
Full Social Benefits: Pension Fund, Education Fund, Disability InsurancePaid Time Off: Flexible Paid Time Off, Paid Parental Leave.
Additional Benefits:
Flexible work environmentTwingate embraces diversity.
We are proud to be an equal opportunity workplace and do not discriminate on the basis of sex, race, color, age, pregnancy, sexual orientation, gender identity or expression, religion, national origin, ancestry, citizenship, marital status, military or veteran status, genetic information, disability status, or any other characteristic protected by federal, provincial, state, or local law.
We are committed to working with and providing reasonable accommodation to individuals with disabilities.
If you would like to request a reasonable accommodation for a medical condition or disability during any part of the application process, please contact us.

Were growing and looking to hire a Data Team Leader who embodies our core values: People First, Customer Obsession, Strive for Excellence, and Integrity.
We are seeking a Data Team Leader with strong technical expertise and a flair for innovation to join our dynamic Data Science and Analytics group. You will play a key role in advancing solution by crafting and sustaining the data collection infrastructures, including cutting-edge LLM data pipelines and web collection frameworks, along with data alliances.
This role requires a visionary leader who is both hands-on and proactive, able to collaborate closely with analysts, data scientists, and product teams to devise scalable solutions. Your mission will be to ensure data reliability and to drive the creation and maintenance of high-scale data collection systems, manage data alliances, and uphold governance within our data collection infrastructure.
Responsibilities:
As Data Team Leader, Your impact will be:
Leading and scaling a team of talented LLM engineers, network analysts, and web scrapers to drive core data initiatives.
Fostering a culture of innovationpromoting continuous learning and high engineering standards.
Defining data collection strategies aligned with business KPIs and ensuring measurable impact.
Maintaining and evolving our data infrastructure, with a strong focus on automation and efficiency.
Working closely with backend developers, PMs, data scientists, analysts, and external data partners to design and deliver robust data solutions.
Integrating and managing data flows across various sources and systems.
Taking ownership of data alliances, budgets, and overall data strategy.

We are looking for a Big Data Software Engineer to join our growing team. In this role, you will be responsible to design and development of our big data processing engine.
Responsibilities:
Design and development of high-quality big data processing engineer
Identify and proactively address potential product risks and challenges and ensuring success.
Work closely with stakeholders to transform requirements into technical specifications.
Ensure that the code is consistent with industry coding standards and best practices.
Take a deep dive into the technical details and provide expert advice and solutions.

Module row data into data warehouse tables according to data modeling roles and practices.
Design data models and lead result driven analytics process based on Checkout strategy needs: such as customer risk scoring model, customers profiling and segmentation models, etc.
Work with stakeholders in the company, such as GTM, Strategy., Risk, Operations, Product, Tech for their data needs collection and prioritization.
Work with central data team and with Checkout data foundation team to define the Checkout data roadmap and deliverable. Create a process to track progress and timeline, while providing visibility to the different stakeholders.
Design analytical solutions for a wide range of Checkout org needs.
Expand data capabilities to support business decisions by providing accurate and user-friendly data models, insight, reports, and dashboards.
Built a process to support new initiatives go/ no go decision process.
Built an infrastructure to support market research and competitor analysis for benchmarking needs.
Be a hands-on manager while also being a strategic leader and bringing value to the Checkout organization.
Create internal documentation and glossaries of Checkout data structure and measurements.
Promote data driven business thinking and create self-service tools to support employees and managers across the organization.

Were building the future workforce of Technology organization, while working tightly with domain owners and top management to define what per-role excellence means, leveraging data from development tools to help infer proficiency levels, providing tailored development plans and training & learning material, and harnessing the individuals themselves for their professional and personal development.
Responsibilities:
Design, implement, and maintain the complete data flow, from extraction to visualization using external tools Work within a product team where solutions are collaboratively proposed. You will be expected to translate requirements into technical designs and implement them as part of large-scale data engineering solutions Utilize various Machine Learning models to explore data, collaborating with cutting-edge Big Data tools and techniques Collaborate with various stakeholders to plan, design, develop, TEST and maintain extraordinary features Collaborating with a team of skilled developers to develop high-traffic, cloud-based applications.