Skip to content

About

Pull the daily arxiv papers for me based on my interested.

Resources

Stars

1 star

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

Repository files navigation

daily_arxiv (astro-ph.SR)

工作日每天中国时间 12:00 自动抓取 arXiv astro-ph.SR 新文,生成推荐分、1句推荐理由、3句中文摘要,并同步到 Notion(同时保留本地备份)。

1. Setup

cd /Users/zhaoyan/Documents/00_allkinds/daily_arxiv
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
cp config/user_profile.example.yaml config/user_profile.yaml
cp .env.example .env

在 .env 填写:

  • NOTION_TOKEN
  • NOTION_DATABASE_ID
  • OPENAI_API_KEY(可选;不填则使用本地降级摘要)

2. Notion Database Schema

请在 Notion 数据库创建以下字段(字段名需一致):

  • Name (Title)
  • ArxivID (Rich text)
  • DateAdded (Date)
  • Authors (Rich text)
  • Affiliations (Rich text)
  • PrimaryCategory (Select)
  • IsCrossListToSR (Checkbox)
  • AbstractEN (Rich text)
  • SummaryZH3 (Rich text)
  • PaperURL (URL)
  • InterestScore (Number)
  • Reason1Line (Rich text)
  • Relevance (Select: 契合, 不契合)
  • OpenNow (Select: 现在点开, 稍后, 跳过)
  • Quality (Select: 高质量, 低质量)
  • FollowAction (Select: 持续关注, 不持续关注, 仅提醒类似)
  • FeedbackNote (Rich text,可选)

3. Run

Daily pipeline

source .venv/bin/activate
./scripts/run_daily.sh

输出:

  • data/raw/YYYY-MM-DD.jsonl
  • data/processed/YYYY-MM-DD_scored.jsonl
  • data/state/last_run_state.json

Weekly learning update

source .venv/bin/activate
./scripts/run_weekly.sh

会执行:

  1. 从 Notion 拉取已打标签记录到 data/processed/feedback.jsonl
  2. 自动更新 config/user_profile.yaml(并生成备份 config/user_profile.yaml.bak)

Recompute interest scores immediately after Notion labeling

当你在 Notion 手动填写标签后,可立即重算并回写 InterestScore:

  • 阅读前:Relevance + OpenNow
  • 阅读后(可选):Quality + FollowAction
source .venv/bin/activate
./scripts/refresh_scores.sh

4. Suggested schedule (macOS cron)

编辑 crontab:

crontab -e

加入:

# 工作日 12:05 (Asia/Shanghai)
TZ=Asia/Shanghai
5 12 * * 1-5 /Users/zhaoyan/Documents/00_allkinds/daily_arxiv/scripts/run_daily.sh >> /Users/zhaoyan/Documents/00_allkinds/daily_arxiv/logs/daily.log 2>&1

# 每周六 12:20 更新偏好
20 12 * * 6 /Users/zhaoyan/Documents/00_allkinds/daily_arxiv/scripts/run_weekly.sh >> /Users/zhaoyan/Documents/00_allkinds/daily_arxiv/logs/weekly.log 2>&1

5. Feedback standard

你每天在 Notion 为文章打 3 个标签:

  • 阅读前(推荐每天都打):
    • Relevance: 契合 / 不契合
    • OpenNow: 现在点开 / 稍后 / 跳过
  • 阅读后(读完再打):
    • Quality: 高质量 / 低质量
    • FollowAction: 持续关注 / 不持续关注 / 仅提醒类似

系统每周会根据这些标签自动调整偏好。

About

Pull the daily arxiv papers for me based on my interested.

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages