Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

S

scalable-c4-preprocessing
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Wiki
- Requirements
- Terraform modules
- Incidents
- Service Desk

Snippets Groups Projects

06f2b8a7

Commit 06f2b8a7 authored 1 month ago by joeld

Downloads
- Patches
- Plain Diff

final adpatons

parent a1ba0603

No related branches found

No related tags found

No related merge requests found

Changes 11

Hide whitespace changes

Inline Side-by-side

Showing

data_loader.py 18 additions, 19 deletions

data_loader.py
environment_initialization.sh 0 additions, 3 deletions

environment_initialization.sh
main.py 20 additions, 47 deletions

main.py
output/processed_0.jsonl 0 additions, 0 deletions

output/processed_0.jsonl
output/processed_1.jsonl 0 additions, 0 deletions

output/processed_1.jsonl
output/shard_0.jsonl 0 additions, 0 deletions

output/shard_0.jsonl
output/shard_1.jsonl 0 additions, 0 deletions

output/shard_1.jsonl
performance_eval.txt 0 additions, 24 deletions

performance_eval.txt
prepare.sh 0 additions, 3 deletions

prepare.sh
preprocess_dataset.sh 17 additions, 8 deletions

preprocess_dataset.sh
processor.py 1 addition, 1 deletion

processor.py

with 56 additions and 105 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment