Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
edde66a
Implement Preprocessing of Pdfs Into Images + Setup Pdfium
JesusFileto Oct 29, 2024
fdb49a5
add cargo.lock
JesusFileto Oct 29, 2024
a5abadf
Merge branch 'hashintel:main' into chonky
JesusFileto Oct 30, 2024
b6daf70
Cleanup + Improve Error Handling
JesusFileto Oct 30, 2024
ef0710b
Implement suggestions + modularize code + fix clippy errors in tests
JesusFileto Oct 30, 2024
5db685e
Optimize page image conversion
JesusFileto Nov 1, 2024
79f6ae6
Add better testing/error handling + Empty Bitmap for Performance
JesusFileto Nov 2, 2024
757974e
Remove blob imports
JesusFileto Nov 2, 2024
9772541
Implement Static Library Linking
JesusFileto Nov 2, 2024
918fdb2
fix merge conflicts
JesusFileto Nov 5, 2024
53bb110
Address comments
JesusFileto Nov 7, 2024
5ddb47b
Update Read Me + Update Pdfium-render
JesusFileto Nov 11, 2024
86dccd3
Merge conflicts
JesusFileto Nov 11, 2024
530fbfc
Rustfmt changes
JesusFileto Nov 11, 2024
1f56190
merge conflicts
JesusFileto Nov 13, 2024
3d7dacb
Yarn Fixes
JesusFileto Nov 13, 2024
3c85a96
Doc Import errors
JesusFileto Nov 13, 2024
f81dc3d
Account for dynamic linking
TimDiekmann Nov 14, 2024
0f4fe8c
Update readme to include PWD
TimDiekmann Nov 14, 2024
0d0f728
Add instructions how to download libraries and fix CI
TimDiekmann Nov 14, 2024
60ce1d8
Fix workflow file for CI
TimDiekmann Nov 14, 2024
811a1fb
Add GH_TOKEN to CI
TimDiekmann Nov 14, 2024
e4bf0fb
Attempt to fix CI
TimDiekmann Nov 14, 2024
c790fbd
Attempt to fix CI, take II
TimDiekmann Nov 14, 2024
d7e1fb2
Add `pwd` to environment variable in CI
TimDiekmann Nov 14, 2024
58a253d
Attempt to fix CI, take IV
TimDiekmann Nov 14, 2024
425230b
Avoid running CI on forks which would always fail
TimDiekmann Nov 14, 2024
188bc46
Move changes to CI to other PR
TimDiekmann Nov 14, 2024
a284f95
Merge branch 'main' into chonky
TimDiekmann Nov 14, 2024
2db9bc7
Merge branch 'main' into chonky
JesusFileto Nov 15, 2024
28335dd
Add `.gitattributes`
TimDiekmann Nov 15, 2024
3e5647c
Merge branch 'main' into chonky
JesusFileto Nov 16, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 24 additions & 0 deletions .github/workflows/test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -136,6 +136,18 @@ jobs:
if: always() && steps.tests.outputs.has-rust == 'true'
run: sudo apt install protobuf-compiler

- name: Install PDFium
if: matrix.package == '@rust/chonky'
env:
GH_TOKEN: ${{ github.token }}
run: |
temp_dir=$(mktemp -d)
gh release download chromium/6721 --repo bblanchon/pdfium-binaries --pattern 'pdfium-linux-x64.tgz' --dir $temp_dir
tar -xzf $temp_dir/pdfium-linux-x64.tgz -C $temp_dir
mv $temp_dir/lib/* "${{ matrix.directory }}/libs/"
rm -rf $temp_dir
echo "PDFIUM_DYNAMIC_LIB_PATH=$(pwd)/${{ matrix.directory }}/libs/" >> $GITHUB_ENV

- name: Install Rust toolchain
if: always() && steps.tests.outputs.has-rust == 'true'
uses: ./.github/actions/install-rust-toolchain
Expand Down Expand Up @@ -269,6 +281,18 @@ jobs:
- name: Install Protobuf
run: sudo apt install protobuf-compiler

- name: Install PDFium
if: matrix.package == '@rust/chonky'
env:
GH_TOKEN: ${{ github.token }}
run: |
temp_dir=$(mktemp -d)
gh release download chromium/6721 --repo bblanchon/pdfium-binaries --pattern 'pdfium-linux-x64.tgz' --dir $temp_dir
tar -xzf $temp_dir/pdfium-linux-x64.tgz -C $temp_dir
mv $temp_dir/lib/* "${{ matrix.directory }}/libs/"
rm -rf $temp_dir
echo "PDFIUM_DYNAMIC_LIB_PATH=$(pwd)/${{ matrix.directory }}/libs/" >> $GITHUB_ENV

- name: Install playwright
if: matrix.package == '@tests/hash-playwright'
uses: nick-fields/retry@7152eba30c6575329ac0576536151aca5a72780e # v3.0.0
Expand Down
Loading