דרושים » תוכנה » Data Engineer Team Lead

We are The Data Science team, focused on Risk Management, our work is centered around compliance and due diligence, specifically Fair Lending and Anti Money Laundering by unmasking the bad guys and solving problems. Our team is working with vital analytics to ensure we are within the guidelines for banking regulations, managing the bank's exposure to loss and risk. Our team uses SAS, Python and various machine learning models to provide on-demand analysis. You will Collaborate with cross-functional teams to understand business requirements, data needs, and project priorities, ensuring alignment of data engineering and BI initiatives with strategic objectives Work closely with business users to define KPIs, metrics, and performance indicators, ensuring alignment with strategic objectives and business priorities Develop and maintain interactive dashboards, reports, and data visualizations using BI tools such as Power BI, Tableau, or similar platforms Extract, clean, transform, and load (ETL) data from various sources such as databases, APIs and spreadsheets to support reporting and analysis activities Perform in-depth data analysis to identify trends, patterns, and insights that drive business decisions and improve operational efficiency Provide training and support to end-users on BI tools and dashboards, empowering them to self-serve and explore data-driven insights Be committed to diversity, equity, and inclusion, with a passion for promoting fairness and equality in lending practices You have
* 5+ years of experience in data analysis, statistical modeling, and predictive analytics within the financial services industry, preferably in Fair Lending or credit decisioning - Must
* Bachelor's degree in computer science, Engineering, Mathematics, Statistics, or related field - Must (Advanced degree an advantage)
* 3+ years of experience in business intelligence, data analysis, or a related role, preferably in a consulting or corporate environment- Must
* Proficiency in BI tools such as Power BI, Tableau, AWS QuickSight, or similar platforms, with hands-on experience developing interactive dashboards and reports Must
* Strong analytical skills, with the ability to analyze complex data sets , draw meaningful conclusions, and communicate insights effectively to stakeholders - Must
* Knowledge of data visualization best practices , including design principles, usability, and accessibility standards - Must
* Familiarity with programming languages such as Python or R for data analysis and visualization
* Ability to collaborate with cross-functional teams and stakeholders at all levels of the organization
* Strong attention to detail, with a focus on data accuracy, completeness, and reliability
* Ability to work independently and as part of a team in a fast-paced environment
* Exhibit problem solving skills, strategic thinking, and anticipate future trends and challenges A Bonus
* Familiarity with Fair Lending regulations such as the Equal Credit Opportunity Act (ECOA), Fair Housing Act (FHA), and Home Mortgage Disclosure Act (HMDA) or other consumer financial protection laws and regulations preferred
* Certification in business intelligence, data analytics, or related field an advantage
* Experience in the financial service sector an advantage
* Experience with big data technologies and frameworks for large-scale data processing and analytics an advantage
* Understanding of industry-specific data and business processes in sectors such as finance and credit an advantage
* Experience with data modeling, data warehousing, and ETL processes an advantage
*  Experience working with cloud-based BI solutions such as Microsoft Azure, AWS, Google Cloud an advantage Why join us Cross River Technologies develops software infrastructure for the fintech industry. Providing innovative technological solutions f

We are looking for a brilliant, quick-learner Data Engineer for our data engineering team - an independent logical thinker who understands the importance of data structuring for macro-business decisions.
The position combines high technical skills with business orientation, working closely with the analysts and the R&D team, and affecting the company's cross-departments decisions directly. Our Data Engineer should have the ability to speak in technical and practical terms, and more importantly, lead from one to the other, while dealing with challenges and creating them - to make our team even better than it is.
Roles and Responsibilities:
Creating and structuring end-to-end data pipelines & ETLs: from the source all the way to the analysts hands, enabling them the ideal conditions to make smart and data driven business decisions.
Cracking top industry data challenges while initiating and building creative technical solutions - in house Device Graph, Server-to-Server to multiple systems, Privacy challenges, Online-to-Offline and more.
Deep understanding of the business needs, technical requirements and the companys roadmap - and translating it into custom made data solutions and scalable products.
Craft code following best practices to ensure efficiency, while integrating CI/CD principles.
Writing multi-step scalable processes from more than 50 data sources - Marketing. Operations, CS, Product, CRM and more... tying them up to a valuable & useful source of insights for the analysts.
Understanding data challenges and weaknesses, and managing high standards monitoring and reliability processes.

Were looking for an exceptional data engineer to join our journey to create a data-based platform that will transform the shipping industry.
As a senior data engineer, you will take an instrumental part in laying the foundations and building the data infrastructure in the company, plan and implement the relevant data infrastructure and tools, be in charge of pipelining the companys data and be responsible for the integrity of the data as we scale up.
Responsibilities:
Contribute to the ongoing management of the data team platform including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues
Designing and optimizing data storage solutions, including data warehouses and data lakes.
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Developing and maintaining data pipelines for efficient extraction, transformation, and loading (ETL) processes.
Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.

Our Data Engineers are responsible for building and operating the data systems to deliver value to the end users and to internal users, by expanding and optimizing the data pipelines and data services, ensuring data integrity and driving a data-driven culture. In addition, you will support our software developers, database architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. This is an amazing opportunity to get into on the ground floor and have a direct hand in designing our companys data architecture to support our first generation of products and data initiatives.

Our ideal candidate is experienced with data pipeline builders and data wranglers, and someone who enjoys optimizing data systems and building them from the ground up. Must be self-directed and comfortable supporting the data needs of multiple teams, systems and products and comfortable working in a fast-paced and often pivoting environment.

Responsibilities
* Build and maintain our data repositories with timely and quality data
* Build and maintain data pipelines from internal databases and SaaS applications
* Create and maintain architecture and systems documentation
* Write maintainable, performant code
* Implement the DevOps, DataOps and FinOps philosophy in everything you do
* Collaborate with Data Analysts and Data Scientists to drive efficiencies for their work
* Collaborate with other functions to ensure data needs are addressed
* Constantly search for automation opportunities
* Constantly improve product quality, security, and performance
* Desire to continually keep up with advancements in data engineering practices

We are looking for an experienced BI Engineer to join our Finance & Operations department.
In this role you will:
Effectively collaborate with our leadership team, product managers, sales and marketing teams, and other stakeholders to scope scalable data infrastructure and analysis approaches to complex business questions.
Develop and optimize ELT/ETL workflows to power business and product analyses based on multiple data sources.
Build compelling data visualizations, reports, and dashboards to serve data-driven decision-making processes.
Create reports, dashboards, responses to ad hoc requests, forecasts, etc. utilizing our data warehouse and other sources of data.
Be a one-person show and collaborate with our data analyst for fast delivery.
Bring in industry best-practices to help pursue the goal of becoming a data-driven company.

we are looking for data Engineer to work on data processing pipeline and lead our data lake and data warehouse building, to help to deliver more insights and scale our data infrastructure. You will have a chance to contribute to the company's evolving culture, bring innovative approaches and learn from your talented colleagues.
Designs and develops programs and tools to support data ingestion, curation, and provision of complex enterprise data to achieve analytics and reporting on our current technology stack Designs and builds data extracts, integrations, and transformations Provides successful deployment and provisioning of data solutions to required environments Designs and builds data architecture and applications that successfully enable speed, quality, and efficiency pipelines Interacts with cross-functional customers and development team to gather and define requirements Develops understanding of the data and builds business acumen Reviews discrepancies in requirements and resolves with stakeholders integrations are automated and have proper exception handling

We are looking for a Data Engineer Team Lead to join our Data Engineering team in Tel Aviv.

You will be leading one of our data platform teams, that is responsible for processing, storing, and serving data for all our core systems.

What Youll Do:

Lead and mentor a data lake team within our data organization.
Drive high-level projects with company-wide visibility.
Manage the team roadmap, team building, and SW project execution.
Collaborate with stakeholders, including developers, product managers, and business operations.
Take full ownership of end-to-end feature development, from design to production. Contribute to building and designing innovative big data solutions.
Research core technologies and integrate with external APIs and services.

We are searching for an innovative and experienced Senior Big Data Engineer that will join us and be part of our big data group.
As a Senior Big Data Engineer, you will:
Lead the architecture and development of mission-critical, diverse and large-scale data pipelines over both public and on-prem cloud solutions.
Derive policies for data storage and versioning over peta-bytes scale complex storage solutions of multiple data lakes.
Design and develop smart ML infrastructure in order to build Agile ML processes (MLOps).
Work with Data Scientists to understand needs and design ML infrastructure solutions
Be a part of a collaborative heterogeneous data team which includes developers, data scientists, data engineers, MLOps and data scouts.

Who We're Looking For - The Dream Maker
We are looking for a hands-on data engineer who will build and develop the entire data engineering capabilities and infrastructure, from scratch. This role will possess a combination of technical expertise, problem-solving skills, and strong communication abilities. It will interface with all the departments of our rapidly growing organization in this transformative period.
Your Arena Data Standardization : Make sure that data is standardized, and manage efforts on that initiative (including past data), create a live documentation for the existing data schema (main entities + each field), ensure that data schema is consistent and participate in design reviews that involve database design, oversee the adoption of a common data access layer for our main DB entities (disputes, customer data, integrations, billing), add and maintain a validation processes ayer to prevent divergence from schema and closed set of value Data Correctness & Integrity : Set up processes to ensure data correctness, validity based on business requirements, processes to detect data duplication in our database, and take actions to remediate this with the business stakeholders Data Optimization and Operations : Monitor and Operate DB Performance, manage indices, alerts, scaling on a daily basis Data Engineering technologies and roadmap : Analyze and choose the right database and related technologies for our evolving needs including data warehouses, data lakes, graph database, relational and non-relational databases and ETL tools. Be a knowledgable source to consult on DB design, optimization and operations for our existing and future DB technologies: Mongodb, dynamodb, rockset, postgres, snowflake. Oversee ETL, ELT processes that are used in the company, both inside R&D and in other departments (R&D, Opertations, Marketing), using AWS Glue, HighTouch, Airbyte. Design data tiering practices to find the tradeoffs for cost/performance/flexibility/query Data Security, Access control and regulation : Support our efforts to map out PII data in our database and limit access to it, Implement encryption at rest and other practices to protect our databases, Execute data deletion tasks like removal of personal data, customer(shop/account) data as part of our SOC2/GDPR compliance Business Intelligence : Choose and configure a BI system that makes all of our data accessible in a single system to various stakeholders and departments in the company (R&D, Product, Operations, Finance, Sales, Marketing, Customer Success, etc.). Create ad-hoc and periodic reports & dashboards for stakeholder, on demand.

Do you want to be a Data Engineer on an elite Data Science team? Do you want to build data solutions that power AI and Data Analytics of a global Security Product? Do you want your work to be impactful on millions of users?

Join us and become part of a winning Data Science team that builds the brain of one of our most exciting security products, our Defender for Endpoint (MDE). As cyber-attacks have become more sophisticated, MDE helps enterprises detect, investigate, and automatically disrupt advanced attacks and data breaches on their networks. Our team is responsible for developing and deploying Machine Learning (ML) models that protect organizations worldwide and owning Data Analytics systems that facilitate data-driven decisions and operational excellence.

If you are an excellent engineer with a background in Big Data, and are passionate about engineering for Data Science, we would like to talk to you!

Responsibilities:
Create and maintain robust Big Data pipelines for Analytics and ML systems.
Optimize performance of Big Data scripts and queries.
Create monitoring and reporting infrastructure.
Develop systems that facilitate Data Science activities such as Analytics and Feature Extraction.