Python Developer

1 semana atrás


Rio de Janeiro, Rio de Janeiro, Brasil ScrumLaunch Tempo inteiro

Python Developer
Home Office / Full time / LATAM / Only resumes in English
- "ScrumLaunch is a Los Angeles based product innovation studio. We work with leading brands and high growth startups to design and build great products._

Responsibilities:

  • Develop and maintain web scraping scripts and tools using Python, focusing on efficiency, reliability, and scalability.
  • Gather requirements from stakeholders and design effective scraping strategies to extract data from websites, considering high volume scenarios.
  • Implement and optimize scraping algorithms to handle complex data structures, dynamic content, and authentication mechanisms.
  • Utilize AWS services such as EC2, S3, Lambda, and Glue for data processing, storage, and computation.
  • Work with message brokers like Redis, Kafka, or RabbitMQ to handle data ingestion and distribution efficiently.
  • Perform data cleansing, transformation, and aggregation to ensure data quality and integrity.
  • Collaborate with crossfunctional teams to integrate scraped data into data pipelines and analytics systems.
  • Utilize Redis as a message broker for efficient and reliable communication between components of the data processing pipeline.
  • Monitor and optimize scraping processes, data workflows, and message queues for performance, scalability, and costeffectiveness.
  • Stay uptodate with the latest web scraping techniques, AWS services, data processing frameworks, and message broker technologies.
  • Troubleshoot and resolve issues related to web scraping, data processing, AWS infrastructure, and Redis message broker.
  • Provide technical guidance and support to junior developers on web scraping, data processing, and message broker implementations.

Qualifications:

  • Proven work experience as a Python Developer with expertise in web scraping.
  • Strong proficiency in Python programming language and related libraries such as BeautifulSoup, Scrapy, or Selenium.
  • Knowledge of AWS services such as EC2, S3, Lambda, Glue, and familiarity with AWS SDKs.
  • Experience with message brokers like Redis, Kafka, or RabbitMQ for efficient data ingestion and distribution.
  • Solid understanding of data processing techniques, ETL concepts, and data storage technologies.
  • Familiarity with database concepts and proficiency in SQL for data manipulation and retrieval.
  • Understanding of web protocols (HTTP, HTTPS), web security best practices, and authentication mechanisms.
  • Ability to analyze and interpret complex website structures and patterns to devise efficient scraping strategies.
  • Strong problemsolving skills and ability to handle high volumes of data efficiently and effectively.
  • Excellent communication skills to effectively collaborate with

We offer:

  • Opportunity to grow as an expert;
  • Flexible working conditions;
  • 12 days of paid vacation;
  • 10 sick days and off days;
  • Friendly and openminded team;
  • English classes

Job Types:
Full-time, Part-time, Temporary, Contract

Ability to commute/relocate:

  • Rio de Janeiro, RJ: Reliably commute or willing to relocate with an employerprovided relocation package (preferred)

  • Python Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil AllCart Tempo inteiro

    DESCRIPTION:AllCart has an opening for a full time python developer to join our data analytics team. This position will be part of our data analytics/machine learning. Some cool things we are working on includes predicting future grocery sales to help consumer save on their monthly grocery bill.REQUIREMENTS: 13 years' experience Strong in Python with ML...

  • Python Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil Zyte Tempo inteiro

    About Us:At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 250 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all...

  • Senior Python Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil AgileEngine Tempo inteiro

    What you will do Work with a data analytics team Support of the Python ecosystems Tools to reduce overhead of refreshing dependencies; Challenges related to Python virtual environments; Ensuring mínimal level of security updates for all unowned/underowned Python libraries; Actively owning and maintaining the top 20 currently unowned python libraries;...


  • Rio de Janeiro, Rio de Janeiro, Brasil Transfero Group Tempo inteiro

    O Grupo Transfero é uma empresa internacional com sede em Zug, Suíça, no coração do Crypto Valley. Nosso propósito _é facilitar e promover o acesso e a adoção de ativos digitais, viabilizando uma transição segura para um sistema financeiro global mais descentralizado e fundamentado na liberdade e autonomia._Oferecemos soluções privadas baseadas...


  • Rio de Janeiro, Rio de Janeiro, Brasil AllCart Tempo inteiro

    DESCRIPTION:Full-time python developer to join our data team. This position will be part of our data analytics/machine learning team.REQUIREMENTS: 13 years experience Strong Python Large scale web scraping Clustering model / Machine Learning Must know Mongo Good team player, selfmotivated and hardworking Salary depending on experience

  • Frontend Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil The BIG Jobsite Tempo inteiro

    About Us:We are looking for a professional to act as a Business Intelligence Developer in onboarding, implementation and consultancy projects for international clients (USA and Canada) of our represented Sisense (sisense.Com), which works with one of the most powerful and renowned BI tools, world leader in embedded analysis and ranked as a visionary in the...


  • Rio de Janeiro, Rio de Janeiro, Brasil Space Talents - Your Career Abroad Tempo inteiro

    The company we're hiring for is a quickly growing technology scale-up that has received multiple international awards for working at the forefront of new geospatial AI technology with global Fortune 500 customers.If you're all about tackling tough challenges and turning innovative ideas all the way from prototype to ready-to-go solutions, we'd love to get to...

  • Senior Snowflake Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil Infopulse Tempo inteiro

    Infopulse is looking for a Senior Snowflake Developer in Brazil for a Healthcare Project.Areas of Responsibility Design, develop, test, and deploy ETL (Extract, Transform, Load) processes using SQL Server Integration Services (SSIS)Collaborate with business stakeholders and data analysts to gather and understand data integration requirements.Create and...


  • Rio de Janeiro, Rio de Janeiro, Brasil Carta Tempo inteiro

    The Problems You'll SolveAt Carta, our employees set out on a mission to unlock the power of equity ownership for more people in more places. We believe that the problems we solve today unlock the opportunities of tomorrow.As a senior software engineer, you'll work to:Here are some problems we need you to help us solve:Carta's developers work in distinct...

  • Senior Snowflake Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil Infopulse Tempo inteiro

    Infopulse is looking for a Senior Snowflake Developer in Brazil for a Healthcare Project. Areas of Responsibility Design, develop, test, and deploy ETL (Extract, Transform, Load) processes using SQL Server Integration Services (SSIS) Collaborate with business stakeholders and data analysts to gather and understand data integration requirements. ...

  • Senior Snowflake Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil Infopulse Tempo inteiro

    Infopulse is looking for a Senior Snowflake Developer in Brazil for a Healthcare Project.Areas of Responsibility: Design, develop, test, and deploy ETL (Extract, Transform, Load) processes using SQL Server Integration Services (SSIS) Collaborate with business stakeholders and data analysts to gather and understand data integration requirements. Create and...

  • Lead Software Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil Magic Media Tempo inteiro

    Magic Media is a pioneering media, entertainment and tech group powered by creativity and innovation. We have a physical presence in 14 countries and expertise in the areas of art, animation, cybersecurity, game development, software development, VFX and video production amongst others. We work with leading developers and publishers within the games and tech...

  • Lead Software Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil Magic Media Tempo inteiro

    Magic Media is a pioneering media, entertainment and tech group powered by creativity and innovation. We have a physical presence in 14 countries and expertise in the areas of art, animation, cybersecurity, game development, software development, VFX and video production amongst others. We work with leading developers and publishers within the games and tech...


  • Rio de Janeiro, Rio de Janeiro, Brasil CARTA Tempo inteiro

    The Company You'll Join Carta is a platform that helps people manage equity, build businesses, and invest in the companies of tomorrow. Our mission is to unlock the power of equity ownership for more people in more places. Carta is trusted by more than 40,000 companies and over two million people in nearly 160 countries to manage cap tables,...

  • Lead Software Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil Magic Media Tempo inteiro

    Magic Media is a pioneering media, entertainment and tech group powered by creativity and innovation. We have a physical presence in 14 countries and expertise in the areas of art, animation, cybersecurity, game development, software development, VFX and video production amongst others. We work with leading developers and publishers within the games and tech...


  • Rio de Janeiro, Rio de Janeiro, Brasil Motorola Solutions Tempo inteiro

    Company OverviewAt Motorola Solutions, we believe that everything starts with safety.Its the constant that empowers people to confidently move forward. It can fill a flight or sell out a stadium. It can care for a patient or graduate a class.As a global leader in public safety and enterprise security, we create and connect the technologies that help to keep...

  • Ai Developer Intern

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil Ibm Tempo inteiro

    IntroductionAs a Data Scientist at IBM, you will help transform our clients' data into tangible business value by analyzing information, communicating outcomes and collaborating on product development. Work with Best in Class open source and visual tools, along with the most flexible and scalable deployment options. Whether it's investigating patient trends...

  • Ruby on Rails Developer

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil Nearsure Tempo inteiro

    What is it like to work at Nearsure? A remote team never felt so close Join our LATAM team and stay connected while working remotely. We value our team members and candidates interested in our vacancies. Enjoy fun activities like coffee breaks, tech talks, and games with our developers and management teams during your stay with us. Who needs...


  • Rio de Janeiro, Rio de Janeiro, Brasil LESTE TELECOM Tempo inteiro

    Por que escolher uma carreira no setor de Desenvolvimento da Leste?Somos reconhecidos como o melhor provedor de internet do Rio de Janeiro, graças à experiência positiva que nossos clientes têm ao assinar os serviços da Leste. Oferecemos uma conexão estável, segura e rápida, e acreditamos que isso se deve à excelência da nossa equipe.Quer fazer...

  • Analista de Sistemas

    1 semana atrás


    Rio de Janeiro, Rio de Janeiro, Brasil OEmprego Tempo inteiro

    Organizar dados laboratoriais em classes e especificação de atributos como suporte operacional ao banco de dados Oracle, utilizando o software PL/SQL Developer; Modelar do banco de dados Oracle utilizando o software Power Designer (todos os Softwares estão instalados nas máquinas dos laboratórios e serão cedidos para realização dos produtos) para...