Skip to content

About

Experimental crawler prototypes go here.

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Repository files navigation

Twig Research

Research for twigslot.com

Experimental ML research, crawler prototypes, and anything that pushes the boundary of twigslot's cabilities go here.

Scraping

To run the wiki spider,

cd twig_scraper
scrapy crawl wiki -O wiki.json

Deploying Autofill Server

To deploy an autofill server,

# Note: remember to change the version from v1.0 
docker build -t tch1001/autofill_server:v1.0 . \
    -f ./api_server/Dockerfile
docker push tch1001/autofill_server:v1.0 
kubectl apply -f kubernetes/autofill-service.yaml

About

Experimental crawler prototypes go here.

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages