What You’ll Be Working On:
At Lumenalta, we partner with enterprise clients to build cutting-edge digital products that interact with hundreds of millions of customers, transactions, and data points. As a Databricks Solutions Architect, you will be pivotal in designing and implementing scalable, high-performance solutions to tackle the most demanding data challenges in various industries. You will have the opportunity to drive end-to-end architecture and help our clients unlock the full potential of their data using Databricks and other modern cloud technologies.
We are looking for someone who can thrive in a fast-paced, collaborative environment, with experience in industries such as FinTech, Transportation, Insurance, Media, or other complex, multifactor environments.
Key Responsibilities:
- Solutions Design: Architect end-to-end scalable data solutions using Databricks, Azure, AWS, and other cloud-based services to meet client requirements.
- Data Strategy & Architecture: Develop robust data architectures, implement ETL pipelines, and establish data governance frameworks to ensure data accuracy and consistency.
- Technical Leadership: Lead the design and implementation of data platforms, define best practices, and mentor team members to elevate technical competencies within the organization.
- Advanced Analytics & Machine Learning: Create pipelines and workflows to support advanced analytics and machine learning initiatives, utilizing Databricks and other cloud-based services.
- Collaboration & Client Engagement: Act as a trusted advisor, working closely with client stakeholders to understand business needs, present architectural solutions, and implement strategies that deliver high-impact results.
- Performance Optimization: Identify bottlenecks and recommend solutions to optimize data workflows and architecture for both cost and performance.
- Innovation & Experimentation: Champion using cutting-edge data technologies and methodologies to drive innovation and experimentation within client projects.
Qualifications & Experience:
- 10+ years of experience in a senior data engineering or solutions architect role, with a strong focus on Databricks, Azure, or AWS cloud ecosystems.
- Proven track record of designing and implementing data architectures that support large-scale data pipelines and analytics.
- Strong proficiency in Python, PySpark, and SQL for data processing and manipulation.
- Extensive experience in creating ETL pipelines from scratch, handling large datasets, and developing solutions that align with business goals.
- Extensive experience interacting with C-Suite level stakeholders
- Hands-on experience with data warehousing concepts, data modelling, and building data marts.
- Industry experience in financial services, logistics, or other complex domains is highly desirable.
- Fluency in verbal and written English, with the ability to communicate complex technical concepts to non-technical stakeholders.
- Personality traits: Analytical, solution-oriented, proactive, team player, and continuously learning.
