morrigan/crabbysearch
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1060 commits 1 branch 0 tags 4.8 MiB
Commit graph

160 commits

Author SHA1 Message Date
Milim
38f04320f0
Merge pull request #1 from MilimTheTrueOne/dependabot/cargo/scraper-0.20.0 
⬆️ Bump scraper from 0.18.1 to 0.20.0
 2024-08-15 14:20:35 +02:00
Milim
f2d6947b12
Merge pull request #2 from MilimTheTrueOne/dependabot/cargo/serde_json-1.0.125 
⬆️ Bump serde_json from 1.0.124 to 1.0.125
 2024-08-15 14:20:27 +02:00
dependabot[bot]
73fdd635cc
⬆️ Bump error-stack from 0.4.1 to 0.5.0 
Bumps [error-stack](https://github.com/hashintel/hash) from 0.4.1 to 0.5.0.
- [Release notes](https://github.com/hashintel/hash/releases)
- [Commits](https://github.com/hashintel/hash/compare/error-stack@0.4.1...error-stack@0.5.0)

---
updated-dependencies:
- dependency-name: error-stack
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-08-15 09:19:48 +00:00
dependabot[bot]
12d2e1d797
⬆️ Bump serde_json from 1.0.124 to 1.0.125 
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.124 to 1.0.125.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.124...1.0.125)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-08-15 09:19:39 +00:00
dependabot[bot]
4413dec3d6
⬆️ Bump scraper from 0.18.1 to 0.20.0 
Bumps [scraper](https://github.com/causal-agent/scraper) from 0.18.1 to 0.20.0.
- [Release notes](https://github.com/causal-agent/scraper/releases)
- [Commits](https://github.com/causal-agent/scraper/compare/v0.18.1...v0.20.0)

---
updated-dependencies:
- dependency-name: scraper
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-08-15 09:19:26 +00:00
Milim
2ca9990e54
fix version 2024-08-15 11:16:37 +02:00
Milim
e66cbea059
rebrand 2024-08-15 11:15:23 +02:00
Milim
b0ed41ef70
some more sanity improvements 2024-08-15 10:45:45 +02:00
Milim
05b6dfda86
remove bad if not even unnecessary relevance calculation and its dependencies 2024-08-15 09:09:41 +02:00
Milim
215a928eb4
remove useless SmallVec dependency, and go insane because it was used with a zero sized array for storage 2024-08-15 09:02:37 +02:00
Milim
99a1089df9
proper config base 2024-08-15 07:53:26 +02:00
Milim
6567af268e
strip garbage 2024-08-14 21:34:18 +02:00
dependabot[bot]
d5524d7eae
⬆️ build(deps): bump reqwest from 0.11.25 to 0.12.4 (#575) 2024-06-08 19:05:09 +00:00
dependabot[bot]
3c2533f69a
build(deps): bump async-compression from 0.4.6 to 0.4.11 (#579) 2024-06-08 18:28:42 +00:00
dependabot[bot]
8225d34a9c
build(deps): bump lightningcss from 1.0.0-alpha.55 to 1.0.0-alpha.57 (#578) 2024-06-08 18:23:44 +00:00
dependabot[bot]
d2954862ea
build(deps): bump mlua from 0.9.6 to 0.9.8 (#577) 2024-06-08 18:19:00 +00:00
dependabot[bot]
f55abf934d
build(deps): bump redis from 0.24.0 to 0.25.4 (#576) 2024-06-07 19:08:26 +00:00
ddotthomas
408858a91e
:bandage: fix: temporary fix for minifying js files (#565) 2024-05-04 19:57:40 +03:00
dependabot[bot]
9058b68f78
build(deps): bump lightningcss from 1.0.0-alpha.54 to 1.0.0-alpha.55 (#563) 2024-05-02 14:25:11 +00:00
dependabot[bot]
9f90caf262
build(deps): bump keyword_extraction from 1.3.0 to 1.4.3 (#562) 2024-05-02 14:11:45 +00:00
dependabot[bot]
1386cd6739
build(deps): bump serde_json from 1.0.114 to 1.0.116 (#561) 2024-05-02 14:06:17 +00:00
dependabot[bot]
fe959efd0e
build(deps): bump async-trait from 0.1.77 to 0.1.80 (#560) 2024-05-02 13:59:45 +00:00
dependabot[bot]
5b6afb0b67
build(deps): bump maud from 0.25.0 to 0.26.0 (#559) 2024-05-02 13:54:52 +00:00
dependabot[bot]
9efcf0b079
build(deps): bump rustls from 0.21.10 to 0.21.11 (#554) 2024-04-20 09:10:14 +00:00
Spencer
bb50e8bb25
✨ Ranking of aggregated search results based on relevancy of the search result to the user's search query (#549) 
* add sorting by relevance and merge new changes

* fix conflicts

* Update src/models/aggregation_models.rs

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* Update src/models/aggregation_models.rs

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* Update Cargo.toml

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* Update Cargo.toml

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* Update Cargo.toml

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* enable non-static-synonyms features

---------

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
 2024-03-25 09:16:49 +00:00
alamin655
f78c6d7660
🔖 chore(release): bump the app version (#547) 2024-03-21 12:18:09 +05:30
neon_arch
d110f72c18
✨ feat: new experimental feature to improve performance using io_uring on linux distributions (#541) 
* ✨ feat: provide a new experimental conditional compilation feature to enable io-uring support (#528)

* 🔖 chore(release): bump the app version (#528)
 2024-03-12 15:36:13 +03:00
neon_arch
991f3f59de
⚡ perf: several optimizations for improving the performance of the engine (#540) 
* ♻️ refactor: initialize & store the config & cache structs as a constant (#486)
- initializes & stores the config & cache structs as a static constant.
- Pass the config & cache structs as a static reference to all the
  functions handling their respective route.

* ⚡ perf: replace hashmaps with vectors for fetching & aggregating results (#486)
- replace hashmaps with vectors for fetching, collecting & aggregating results as it tends to be contigous & cache efficient data structure.
- refactor & redesign algorithms for fetching & aggregating results
  centered around vectors in aggregate function.

* ➕ build: add the future crate (#486)

* ⚡ perf: use `futureunordered` for collecting results fetched from the tokio spawn tasks (#486)
- using the `futureunordered` instead of vector for collecting results
  reduces the time it takes to fetch the results as the results do not
  need to come in specific order so any result that gets fetched first
  gets collected in the `futureunordered` type.

Co-authored-by: Spencerjibz <spencernajib2@gmail.com>

* ⚡ perf: initialize new async connections parallely using tokio spawn tasks (#486)

* ⚡ perf: initialize redis pipeline struct once with the default size of 3 (#486)

* ⚡ perf: reduce branch predictions by reducing conditional code branches (#486)

* ✅ test(unit): provide unit test for the `get_safesearch_level` function (#486)

* ⚡ perf: reduce clones & use index based loop to improve search results filtering performance (#486)

* 🚨 fix(clippy): make clippy/format checks happy (#486)

* 🚨 fix(build): make the cargo build check happy (#486)

* ⚡ perf: reduce the amount of clones, to_owneds & to_strings (#486)

* ⚡ perf: use async crates & methods & make functions async (#486)

* 🔖 chore(release): bump the app version (#486)

---------

Co-authored-by: Spencerjibz <spencernajib2@gmail.com>
 2024-03-11 12:01:30 +03:00
dependabot[bot]
c494edcaff
build(deps): bump reqwest from 0.11.23 to 0.11.24 (#537) 2024-03-02 09:50:36 +00:00
dependabot[bot]
6aab9c85b9
build(deps): bump tempfile from 3.9.0 to 3.10.1 (#536) 2024-03-02 09:46:09 +00:00
dependabot[bot]
1d133ed2a8
build(deps): bump log from 0.4.20 to 0.4.21 (#535) 2024-03-02 09:09:20 +00:00
dependabot[bot]
d020895a51
build(deps): bump actix-cors from 0.6.5 to 0.7.0 (#534) 2024-03-02 09:04:34 +00:00
dependabot[bot]
b7a3a8d855
build(deps): bump dhat from 0.3.2 to 0.3.3 (#533) 2024-03-02 06:57:42 +00:00
alamin655
2df6499fb2
📝 docs(instances): more instances with the rolling/edge version (#495) 
* add 2 additional instance

Added two new instance
- https://websurfx.instance.pp.ua
- https://alamin655-spacex.hf.space

Changed the `Managed by` column to `Status`

* 🔖 chore(release): bump the app version (#495)

* 🔖 chore(release): bump the app version (#495)

* 🔖 chore(release): bump the app version (#495)

* 🔖 chore(release): bump the app version (#495)

* Remove unnecessary line

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* Update docs/instances.md

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* Update instances.md

* bump version

* bump version

* Update instances.md

* Update instances.md

* use shields.io

* Update instances.md

* change websurfx.co to websurfx.pp.ua

* update the status badge

* bump app version

v1.9.20

* Add maintained by

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

---------

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
 2024-02-08 07:52:16 +03:00
dependabot[bot]
8790f5f719
build(deps): bump actix-files from 0.6.2 to 0.6.5 (#511) 2024-02-02 07:29:35 +00:00
dependabot[bot]
0f19ade40c
build(deps): bump env_logger from 0.10.1 to 0.11.1 (#512) 2024-02-02 07:24:55 +00:00
dependabot[bot]
ae5b3370bc
build(deps): bump smallvec from 1.11.2 to 1.13.1 (#514) 2024-02-02 07:20:11 +00:00
dependabot[bot]
3d76b1bd86
build(deps): bump lightningcss from 1.0.0-alpha.51 to 1.0.0-alpha.52 (#513) 2024-02-02 07:14:54 +00:00
dependabot[bot]
6c3d9ecd50
⬆️ build(deps): bump serde from 1.0.193 to 1.0.196 (#510) 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.193 to 1.0.196.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.193...v1.0.196)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
 2024-02-02 10:10:08 +03:00
Spencerjibz
29b76be459 dump up package version 2024-01-24 12:47:19 +00:00
Evan Yang
efa8efc6c7
✨ Compression and encryption for the cached search results (#443) 
* attempt1

* rough draft

* add features and their optional dependancies

* add encryption and compression error variants

* add  a sample implementation to cache trait

* Update src/cache/cacher.rs

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* adjust comment so feature flag would apply?

* adjust feature flag so it applies?

* formatting

* Update src/cache/cacher.rs

update documentation

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* [features]Add base64 and chacha20 dependencies for compress-cache-results and encrypt-cache-results

* move encryption key and cipher logic to separate sub module

* added cacha20 and cec-results feature

* added cacha20 and cec-results feature

* added compression and encryption helper functions to trait implementations

* added compression and encryption  implementation for inMemoryCache

* base64 is only requried when redis-cache feature is enabled

* add error case for base64 and encryption/compression implementation to redisCache

* Refactor cacher to remove regex dependency

* fmt cache error and cacher

* Update Cargo.toml

disabling the unneeded default-features

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* fix unused import warning for mimalloc

* remove deprecated method

* add doc comments for encryption module

* fix known bugs and use cfg-if module

* make cfg-if an optional dependency

* use feature-flag instead of maco lint

* add comment to explain type complexity

* bump app version

* Update src/cache/encryption.rs

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* fixed type complexity and add docs for types

---------

Co-authored-by: Spencer Najib <spencernajib2@gmail.com>
Co-authored-by: alamin655 <mdalamin655@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
Co-authored-by: Spencerjibz <=spencernajib2@gmail.com>
Co-authored-by: spencer <spencer@DESKTOP-SIF13AR>
 2024-01-11 11:10:35 +00:00
dependabot[bot]
3a97a6f621
⬆️ build(deps): bump async-trait from 0.1.75 to 0.1.76 (#481) 
Bumps [async-trait](https://github.com/dtolnay/async-trait) from 0.1.75 to 0.1.76.
- [Release notes](https://github.com/dtolnay/async-trait/releases)
- [Commits](https://github.com/dtolnay/async-trait/compare/0.1.75...0.1.76)

---
updated-dependencies:
- dependency-name: async-trait
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
 2024-01-02 10:21:40 +03:00
dependabot[bot]
92a141c1c5
⬆️ build(deps): bump redis from 0.23.3 to 0.24.0 (#480) 
Bumps [redis](https://github.com/redis-rs/redis-rs) from 0.23.3 to 0.24.0.
- [Release notes](https://github.com/redis-rs/redis-rs/releases)
- [Commits](https://github.com/redis-rs/redis-rs/compare/redis-0.23.3...redis-0.24.0)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
 2024-01-02 10:15:12 +03:00
dependabot[bot]
c73cb838e2
⬆️ build(deps): bump minify-js from 0.5.6 to 0.6.0 (#479) 
Bumps [minify-js](https://github.com/wilsonzlin/minify-js) from 0.5.6 to 0.6.0.
- [Commits](https://github.com/wilsonzlin/minify-js/compare/v0.5.6...v0.6.0)

---
updated-dependencies:
- dependency-name: minify-js
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
 2024-01-02 10:08:59 +03:00
dependabot[bot]
ebd69ff427
⬆️ build(deps): bump serde_json from 1.0.108 to 1.0.109 (#478) 
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.108 to 1.0.109.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.108...v1.0.109)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
 2024-01-02 09:40:46 +03:00
neon_arch
f2907641d2 🔖 chore(release): bump the app version (#468) 2023-12-30 13:08:55 +03:00
neon_arch
96ed04c298 🔖 chore: bump the app version (#439) 2023-12-23 20:23:41 +03:00
alamin655
86b1f62393
🔖 chore(release): bump the app version (#436) 
v1.5.3
 2023-12-11 09:35:39 +05:30
alamin655
918d142d24
🔖 chore(release): bump the app version (#435) 
v1.5.2
 2023-12-11 09:10:25 +05:30
alamin655
c02006c297
✨ LibreX for the search engine (#429) 
* ✨ feat(engine): provide librex search engine (#318)

* ✨ feat(engine): provide librex search engine (#318)

* ✨ feat(engine): provide librex search engine (#318)

* 🔖 chore(release): bump the app version (#318)

* 🔖 chore(release): bump the app version (#318)

* ✨ feat(engine): provide librex search engine (#318)

* ✨ feat(engine): provide librex search engine (#429)

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* ✨ feat(engine): provide librex search engine (#429)

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* ✨ feat(engine): provide librex search engine (#429)

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

* ✨ feat(engine): provide librex search engine (#429)

* ✨ feat(engine): provide librex search engine (#429)

* ✨ feat(engine): provide librex search engine (#429)

* ✨ feat(engine): provide librex search engine (#429)

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>

---------

Co-authored-by: neon_arch <mustafadhuleb53@gmail.com>
 2023-12-09 14:25:28 +03:00