Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system.

Requirements

  • At least 5 year of relevant experience in data engineering, web scraping, automation, or software development (required)
  • Bachelor's or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus
  • Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
  • Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
  • Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
  • Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
  • Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
  • Strong attention to detail and commitment to data accuracy
  • Self-directed work ethic with ability to troubleshoot independently

Benefits

  • On this project, contributors can earn up to $30 per hour equivalent, depending on their level and pace of contribution
  • Participate in performance-based bonus programs that reward high-quality work and consistent delivery