Senior Data Engineer
This job is no longer accepting applications
See open jobs at Thrive Market.See open jobs similar to "Senior Data Engineer" M13.Data Science
Los Angeles, CA, USA · Remote
RESPONSIBILITIES
- Work across multiple projects and efforts to orchestrate and deliver cohesive data engineering solutions in partnership with various functional teams at Thrive Market
- Be hands-on and take ownership of the complete cycle of data services, from data ingestion, data processing, ETL to data delivery for reporting
- Collaborate with other technical teams to deliver data solutions which meet business and technical requirements; define technical requirements and implementation details for the underlying data lake, data warehouse and data marts
- Identify, troubleshoot and resolve production data integrity and performance issues
- Collaborate with all areas of data management as lead to ensure patterns, decisions, and tooling is implemented in accordance with enterprise standards
- Perform data source gap analysis and create data source/target catalogs and mappings
- Develop a thorough knowledge and understanding of cross system integration, interactions and relationships in order to develop an enterprise view of Thrive Market’s future data needs
- Design, coordinate and execute pilots/prototypes/POC to provide validation on specific scenarios and provide implementation roadmap
- Recommend/Ensure technical functionality (e.g. scalability, security, performance, data recovery, reliability, etc.) for Data Engineering
- Facilitate workshops to define requirements and develop data solution designs
- Apply enterprise and solution architecture decisions to data architecture frameworks and data models
- Maintain a repository of all data architecture artifacts and procedures
- Collaborate with IT teams, software providers and business owners to predict and devise data architecture that addresses business needs for collection, aggregation and interaction with multiple data streams
QUALIFICATIONS
- Hands on experience programming in Python, Scala or Java
- Expertise with RDBMS and Data Warehousing (Strong SQL) with Redshift,Snowflake or similar
- In-depth knowledge and experience with data and information architecture patterns and implementation approaches for Operational Data Stores, Data Warehouses, Data Marts and Data Lakes
- Proficiency in logical/physical data architecture, design and development
- Experience in Data lake / Big data analytics platform implementation either cloud based or on-premise; AWS preferred
- Experience working with high volumes of data; experience in design, implementation and support of highly distributed data applications
- Experience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration E.g. GitHub, Jenkins, Concourse, Airflow, Terraform
- Experience with writing Kafka producers and consumers or experience with AWS Kinesis
- Hands-on experience developing a distributed data processing platform with Big Data technologies like Hadoop, Spark etc
- A knack for independence (hands-on) as well as team work
- Excellent analytical and problem-solving skills, often in light of ill-defined issues or conflicting information.
- Experience with streaming data ingestion, machine-learning, Apache Spark a plus
- Adept in the ability to elicit, gather, and manage requirements in an Agile delivery environment
- Excellent communication and presentation skills (verbal, written, presentation) across all levels of the organization. Ability to translate ambiguous concepts into tangible ideas.
BELONG TO A BETTER COMPANY
- Comprehensive health benefits (medical, dental, vision, life and disability)
- Competitive salary (DOE) + equity
- 401k plan
- 9 Observed Holidays
- Flexible Paid Time Off
- Subsidized ClassPass Membership with access to fitness classes and wellness and beauty experiences
- Ability to work in our beautiful co-working space at WeWork in Playa Vista and other locations
- Free Thrive Market membership with exclusive employee discount
- Coverage for Life Coaching & Therapy Sessions on our holistic mental health and well-being platform
JOB INFORMATION
- Compensation Description - The base salary range for this position is $160,000 - $190,000/Per Year.
- Compensation may vary outside of this range depending on several factors, including a candidate’s qualifications, skills, competencies and experience, and geographic location.
- Total Compensation includes Base Salary, Stock Options, Health & Wellness Benefits, Flexible PTO, and more!
This job is no longer accepting applications
See open jobs at Thrive Market.See open jobs similar to "Senior Data Engineer" M13.
