Skip to content

More flexibility in Saluki model - #5

Merged
isaacvock merged 2 commits into
mainfrom
develop
Aug 2, 2026
Merged

More flexibility in Saluki model#5
isaacvock merged 2 commits into
mainfrom
develop

Conversation

@isaacvock

Copy link
Copy Markdown
Collaborator

Users can now:

  1. Use LayerNorm in head rather than BatchNorm. I might actually switch this to the default, as it stabilizes training by avoiding stochastic shifts in the mean prediction from epoch to epoch.
  2. Use Average rather than Max pooling in the convolution stem

@isaacvock
isaacvock merged commit eec9e78 into main Aug 2, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant