Senior Data Engineer
Founding Data Engineer -- Series C Funded -- 100% Remote
  • REMOTE
  • Palo Alto, CA
  • $140,000 - $170,000
Easy Apply Now

A bit about us:

Well Funded Series C Organization

In just over 5 years our business has grown tenfold and we have thousands of customers across the world. This is still a young company--there's a lot of opportunity for growth.

Why join us?

* Unlimited paid time off
* 99% Work from Home
* Excellent Salary and Stock Options Package
* 401(k) plan and flexible spending benefits
* Growth/Leadership Opportunity

Job Details

(Founding) Sr Data Engineer

We are looking for a Data Engineer with experience developing efficient, robust and scalable data solutions to enable data-driven decision making.

As the founding member of the data engineering team, you will be responsible for leading our next generation data platform effort, owning the data ETL processes, and facilitating production deployment of data science modeling solutions. You will establish the data lake and build the data warehouse by ingesting and transforming hundreds of thousands inventory movement data from WMS (warehouse management system) tens of thousands transaction data from ERP (enterprise resource planning) on a weekly basis, along with task data from delivery and fulfillment platform and session data from APP logs, encompassing thousands of catalog items.

Responsibilities
  • Enhance the existing batch processing pipeline to reduce latency, gain visibility into cluster performance, and monitor pipeline performance
  • Work with the data science team to design and build the next generation of data environments in a scalable way to handle the rapid growth of catalog and APP event logs
  • Collaborate with backend engineers for seamless data ingestion, and with front end and mobile engineers for event-driven data collection
  • Establish a model deployment process for data scientists into production
  • Provide technical leadership / mentorship as you grow the data engineering team
  • Guide data users to most efficiently use the data platforms and tools

Qualifications
  • 5+ years of hands-on experience in data engineering
  • Solid understanding of data structures on distributed systems, ETL processes, data schema design, orchestrating pipelines via JDBC / PostgreSQL / EDI, microservices, and query optimization
  • Expert knowledge in AWS products (e.g., Lambda, Batch, EC2, S3, RedShift, EMR)
  • Strong competency in programming languages (e.g., Python, Ruby, Scala, Java), data processing / streaming tools (e.g., Airflow, Hive, Spark, RabbitMQ, MongoDB, Hadoop, Zookeeper)
  • Knowledge of ERP (e.g., NetSuite) and WMS (e.g., JDA) software solutions
  • Knowledge of container applications (e.g., Docker) and container orchestration systems (e.g., Kubernetes)

Easy Apply Now
Easy Apply Now
Job Details
Managed by Jobot Pro
Location
REMOTE
Job Type
Permanent
Compensation
$140,000 - $170,000