Spack scraping lq - #154

Open

lfquintaz wants to merge 21 commits into

mainfrom

spack_scraping_LQ

Commits on Jul 16, 2025

initial spack dataset scraper
lfquintaz
committed
526dd7a
added practice message of "meow"
lfquintaz
committed
8421d96

Commits on Jul 19, 2025

added methods to create local cache for easy interrupt/proceed from last processed package
lfquintaz
committed
ac16bd8

Commits on Aug 11, 2025

added files to capture failed manifest/tarball download
lfquintaz
authored
c362a96
added atomic save functions for manifest and tarballs
lfquintaz
authored
059f205
Add files via upload
lfquintaz
authored
b5e46e0

Commits on Aug 15, 2025

removed print statement at restart that shows all the fully processed tarball hashes
lfquintaz
committed
601f74a
merged diverged branch file updates in spack_db.py
lfquintaz
committed
9ed218f
added Create_spack_DB.py
lfquintaz
committed
670be16

Commits on Aug 16, 2025

added test files
lfquintaz
committed
cefc0fc

Commits on Aug 18, 2025

updated remove_lines_spec_manifest function
lfquintaz
committed
81afc13
added README.md
lfquintaz
committed
f189767
fixed bullet points in Directory Structure and Features
lfquintaz
committed
b434859
fixed bullet points for the layout of the index
lfquintaz
committed
bfa7dbe
updated Usage
lfquintaz
committed
c3ba8d5

Commits on Aug 19, 2025

updated README.md with retry manifest/tarball download instruction
lfquintaz
committed
fe63504
updated _to_posix for printing
lfquintaz
committed
19e76fb

Commits on Aug 21, 2025

removed spec_manifest info from README.md
lfquintaz
committed
880f545
removed 'updated' comments
lfquintaz
committed
b2de168
removed 'contributing' from README.md
lfquintaz
committed
dc0ad5c
added supporting scripts for testing
lfquintaz
committed
9ebd7fc