Web Login Archives - Open Source Automation

21Apr 2020 by Andrew Treadway

How to check if groceries are in stock and automatically buy them with R

R, Web Scraping

Background Anyone who's bought groceries online recently has seen the huge increase in demand due to the COVID-19 outbreak and quarantines. In this post, you'll learn how to buy groceries on Amazon using R! To do that, we'll be using the RSelenium package. In case you're not familiar, Selenium is a browser automation tool. It works like a normal browser, except that you write code to perform operations, such as navigating to websites, filling in forms online, clicking links and buttons, etc. This way, it's similar to writing a macro in Excel - except for a web browswer. Several different languages, including Python and R, have packages that allow you to use Selenium by writing code in their language. R's package for this, as mentioned above, is RSelenium. Getting started…

29Sep 2017 by Andrew Treadway

Downloading Every File on an FTP Server

File Manipulation, Python, Web Login

Getting Started Before I go into the title of this article, I'm going to give an introduction to using Python to work with FTP sites. In our example, I will use (and extend upon) some of the code written in the yahoo_fin package. To work with FTP servers, we can use ftplib, which comes with the Python standard library, so you’ll probably already have it installed. In case you don’t, however, you can download it using pip: [code lang="python"] pip install ftplib [/code] To log into an FTP site, we first need to establish a connection. You can do this using the FTP method. Just replace ftp.nasdaqtrader.com with whatever FTP site you want to log into. [code lang="python"] '''Load the ftplib package ''' import ftplib '''Connect to FTP site''' ftp…

Tag: Web Login