Skip to content

An example of Scrape from Twitter Users' profile with multiprocessing - #154

Open
cenguix wants to merge 16 commits into
masterfrom
scrape_from_profile
Open

An example of Scrape from Twitter Users' profile with multiprocessing#154
cenguix wants to merge 16 commits into
masterfrom
scrape_from_profile

Conversation

@cenguix

@cenguix cenguix commented Nov 2, 2018

Copy link
Copy Markdown
Contributor

taspinar added 16 commits June 13, 2018 20:49
useragents will no longer be generated with the fake_useragent package.
At the moment seven of the most popular useragent strings are written hardcoded in query.py
In later stages this should be done via a separate module.

This fixes #118,
#115,
#90
- Added CLA -u / --user to main.py which call the method query_tweets_from_user when set
- query.py: query_tweets_from_user method call query_single_page method with a different INIT and RELOAD URL.
- query.py: from_user argument is added to query_single_page so that a different pos value is returned.

This fixes #120
-include examples and usage of -u / --user argument introduced in version 0.9.0
@Camilo-Lesmes

Camilo-Lesmes commented Nov 2, 2018

Copy link
Copy Markdown

hi, today I searched several times and I couldn't find anything but yesterday I got the tweets correctly

@taspinar

taspinar commented Nov 4, 2018

Copy link
Copy Markdown
Owner

@cenguix This is not really the proper way to submit a PR, but I'll merge your code together with something I have developed for getting user account information.

@lapp0 lapp0 added the stale label Jun 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants