About the Role

As a Lead Software Engineer, you will play a pivotal role in the Data-as-a-Service Engineering team, focusing on the development and maintenance of services and tools that drive our data ecosystem. This includes overseeing the technologies involved in the ingestion of raw data into a large-scale data warehouse and the delivery of processed, de-identified, and linked data to clients. Your responsibilities will encompass maintaining the foundational platforms for data exchange and enhancing user experiences to ensure seamless client interaction.

Responsibilities

• Develop innovative services to support the ingestion, storage, discovery, and extraction of data throughout the data ecosystem.
• Design and architect well-encapsulated microservices that facilitate data exchange and enhance end-user experiences.
• Create user interfaces that enable internal and external users to engage with data exchange processes effectively.
• Collaborate with a team of skilled engineers through pair programming and code reviews.
• Partner with product teams to understand user needs and build software solutions that address those needs.
• Enhance the software development process through agile methodologies.
• Mentor junior engineers and promote a collaborative and learning-focused environment.

Tech Stack

• Github, Python, Postgres, React, AWS Cloud-native technologies (CDK, Lambda, S3, ECS, SQS, Eventbridge, DynamoDB), Spark, Databricks

Success Metrics

• Maintain high throughput and velocity.
• Assess the technical feasibility of complex requests across multiple systems.
• Optimize systems within known constraints.
• Foster a strong team culture with a focus on cross-functional collaboration.

Required Skills and Experience

• 8+ years of software development experience.
• 5+ years of experience with Python.
• 3+ years of cloud experience using infrastructure-as-code tools.
• 3+ years of experience with JavaScript or modern UI frameworks (React preferred).
• Experience with continuous integration and continuous deployment technologies.
• 3+ years of experience building data pipelines.

Desired Skills and Experience

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Experience developing software in a fast-paced, startup environment.
• Background in regulated industries such as healthcare or finance with compliance requirements.
• Experience with application architecture, microservice architecture, event-driven architectures, messaging systems, and domain-driven design.
• Familiarity with Lean/Agile development methodologies.
• 3+ years of experience with Spark or similar technologies.

Compensation

Base salary for this role is competitive and ranges from $70,000 to $220,000, with additional annual bonus opportunities based on experience.