Applications for this position are currently paused

Senior Data Engineer, DataOps

Save
Job updated about 3 years ago

Job Description

Rosetta.ai helps fashion e-commerce uncover consumer's shopping preferences and provide personalized shopping experiences to consumers. We're making e-commerce merchants have enterprise-level AI backup on day 1.

We are looking for a Data Engineer of DataOps, to not only build data pipelines but also extend the next generation of our data tools. As a Data Engineer of DataOps, you will develop a clear sense of connection with our organization and leadership.

In this role, you will define and find solutions to complex and ambiguous problems. You will be leveraging your deep knowledge and experience to collaboratively define the technical vision, strategy, and architecture for ETL, Logging, Streaming, Batch/Compute engines (Presto/Spark), Semantic Data and Metadata models, ML workflows, Consumption workflows (Visualization/Notebooks), and Big Data development lifecycle (coding, testing, deploying, discovery, etc.)

    

Responsibilities:
  • Build and data (dimensional) model core datasets and analytics applications and make them scalable and fault-tolerant. 
  • Craft and own the optimal data processing architecture and systems for new data and ETL pipelines/analytics applications
  • Drive internal process improvements and automating manual processes for data quality checks and SLA management.
  • Apply proven expertise and build high-performance scalable data warehouses, online caches, and real-time systems.
  • Work with data infrastructure to triage infra issues and drive to resolution.
  • Support existing processes running in production.
  • Build visualizations to provide insights into the data & metrics.
  • Articulate strategy within teams and effectively communicate with cross-functional.
  • Immerse yourself in all aspects of the product, understand the problems, and tie them back to data engineering solutions.

        

    Benefits:
    • Healthcare (Medical, Dental, Vision)
    • Retirement savings or 401(K)
    • Paid time off (Annual; 10 days)
    • Maternity/Paternity leave
    • Life insurance
    Perks:
    • Tuition reimbursement and training
    • Personal facilities (Laptop, Screen)
    • Free health screening
    • Free snacks and drinks
    • Open and creative environment
    • Irregular dinner/outing, happy hours
    • Extended annual time off
    • Paid time off to volunteer (Birthday, Menstrual, Funeral)
    • Flexible schedules and working time
    • Remote working optionally
    • Employee stock ownership plan (ESOP)

            

    Culture/6 Core Values:

    Grit - We thrive outside of our comfort zone, pushing ourselves to go even further. We think long-term and constantly strive to be better, even if things don’t always go as expected.

    Trust - We earn that trust by listening to each other, following through with our commitments, and keeping our words. We exercise transparency within the company, our customers, and our community.

    Humility - We learn from everyone and everywhere, and we approach each new challenge knowing that we may not have all the answers.

    Empathy - We craft our intention to keep curious about the industry, business, and practical scenarios that we purify the insights and forge the approaches.

    Candor - We are open and honest. We give each other praise and criticism because we believe each team member is as important as the other.

    Craftsmanship - We simplify, innovate, perfect, and start over until everything we touch enhances each life it touches.

            

    Contact:

        

    Remarks:

    Rosetta.ai is an Equal Employment Opportunity employer. Rosetta.ai conducts all employment-related activities without regard to race, religion, color, national origin, age, sex, marital status, sexual orientation, disability, citizenship status, genetics, or any other characteristic protected by law.

    Requirements

    [Minimum Qualifications]
        
    Background & Skills:
    • BS/BA in Technical Field, Computer Science, or Mathematics.
    • Experience with writing complex SQL statements.
    • Experience with data engineering, applying Data Warehousing, and ETL best practices.
    • Experience with either a MapReduce or an MPP system.
    • Experience with schema design and dimensional data modeling.
    • Experience with anomaly/outlier detection.
    • Experience in LAMP and the Big Data stack environments (Hadoop, MapReduce, Hive).
    • Experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M).
    • Ability in managing and communicating data warehouse plans to internal clients.
         
    Working Style:
    • Communication skills including the ability to identify and communicate data-driven insights.
    • Ability to analyze data to identify opportunities, deliverables, gaps, and inconsistencies.
    • Flexibility and comfort working in a dynamic, team environment with a possible remote organization with minimal documentation and process.

        

    [Preferred Qualifications] (Optionally, the more, the better)
        
    Background & Skills:
    • Knowledge in Python or Java or Scala or Pandas.
    • Designing and implementing real-time pipelines.
    • Experience with data quality and validation.
    • Experience with SQL performance tuning and e2e process optimization.
    • Experience with notebook-based Data Science workflow.         
         
    Experience:
    • Experience collaborating, defining, and communicating complex technical concepts to a broad variety of audiences.
    • Experience with cloud or on-prem Big Data/MPP analytics platform (i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar).
    • Experience with scaling analytics architecture and worked with open-source big-data stacks (Spark, Koalas, etc.)
    • Experience with Airflow.
    • Experience with ELK.
    • Experience querying massive datasets using Spark, Presto, Hive, Impala, etc.
    • Experience with filesystems, server architectures, and distributed systems.
    View all jobs
    View all jobs
    Save
    1
    840,000 ~ 1,000,000 TWD / year
    Managing 1-5 staff
    Optional Remote Work
    Personal Invitation Link
    This is your personal referral link for job invitation. You'll receive an email notification when someone applied for the position via your job link.
    Share this job
    Logo of Rosetta.ai.

    About us

    Rosetta.ai is a SaaS company serving the ecommerce brands since 2016.
    🏆 2019 RecSys Reward
    🏆 2020 Forbes Top 25 Machine Learning Startups

    • Our clients care deeply about their shoppers and understand the value of unique online experiences.
    • We specialize in supporting fashion ecommerce clients in the apparel, accessories, and cosmetics verticals.
    • Our Customer-Intent Web App adds value to our client’s first-party data via automated preference analysis and onsite personalized recommendations.
    • The app is powered by AI and machine learning technology developed in house by industry leading engineers and fashion savvy marketers.
    • We are a young, fun, and diversified team that believes that company growth is driven by everyone’s growth. Together, from good to great — join us today! 

    Rosetta.ai 是一間多元、年輕且有遠景的軟體新創公司,於 2016 年創立便投入時尚電商領域,以美學 AI 為客戶打造一流的推薦系統,並與客戶一起成長,紮實的技術底蘊獲得海外創投青睞,正快速發展當中!
    在 Rosetta.ai 我們設計與開發一流的軟體服務,運用最新的 AI 與機器學習技術,協助客戶深入了解消費者的喜好與需求,將對的商品展示給對的人,打造獨一無二的購物體驗。
    我們相信公司成長是建立在每個人的成長上,與一流的人才一起工作、一起玩樂、一起成長,現在就加入我們!


    Team

    Avatar of the user.
    Co-founder & CEO
    Avatar of the user.
    Co-founder & COO
    Avatar of the user.
    Co-founder & CTO
    Avatar of the user.
    Business Development Manager

    Jobs

    Full-time
    Mid-Senior level
    2
    840K ~ 1.2M TWD / year
    Save

    Full-time
    Mid-Senior level
    2
    780K ~ 1.44M TWD / year
    Save

    Full-time
    Mid-Senior level
    3
    840K ~ 1.8M TWD / year
    Save