Nicolas
|
12ec519f9b
|
Update docker-compose.yaml
|
2024-07-17 22:44:23 -04:00 |
|
Nicolas
|
2fab2d8d29
|
Update scrape.ts
|
2024-07-17 20:44:34 -04:00 |
|
Nicolas
|
6609c1b6e5
|
Update .env.local
|
2024-07-17 16:22:27 -04:00 |
|
Nicolas
|
17a1f9b55f
|
Update .env.example
|
2024-07-17 16:22:04 -04:00 |
rafaelsideguide
|
eda616d728
|
Merge remote-tracking branch 'origin/main' into docs/update-docs
|
2024-07-17 16:44:51 -03:00 |
|
rafaelsideguide
|
2b4ce12097
|
Update openapi.json
|
2024-07-17 16:43:22 -03:00 |
Gergo Moricz
|
8160c311c0
|
fix queue stuck bug via lock setting changes
|
2024-07-17 21:31:25 +02:00 |
Caleb Peffer
|
8d5ebc9b9f
|
Merge pull request #423 from mendableai/cjp/linksOnPage
Caleb: Return a list of links on a page by default
|
2024-07-17 12:36:07 -06:00 |
|
Caleb Peffer
|
5b24d26c84
|
Caleb; fixed test
|
2024-07-17 11:33:12 -07:00 |
|
Caleb Peffer
|
c5d1e7260d
|
Caleb: made changes per Rafaels requests
|
2024-07-17 11:29:05 -07:00 |
|
rafaelsideguide
|
205cd63c2f
|
Update openapi.json
|
2024-07-17 15:07:06 -03:00 |
|
Rafael Miller
|
f020048a46
|
Merge pull request #420 from mendableai/bugfix/empty-tags
Small fix for empty pageOptions
|
2024-07-17 10:10:24 -03:00 |
|
Caleb Peffer
|
da3c6bca37
|
Caleb: added a simple test
|
2024-07-16 21:23:22 -07:00 |
|
Caleb Peffer
|
0b3c0ede49
|
Added tests per @nicks request
|
2024-07-16 21:15:59 -07:00 |
|
Caleb Peffer
|
98c788ca7a
|
Caleb: added a test to ensure links on page exists and isn't zero on mendable
|
2024-07-16 21:13:52 -07:00 |
|
Nicolas
|
d7f185428f
|
Merge pull request #424 from mendableai/nsc/seperate-rate-limit
Redis Health Checks
|
2024-07-16 22:53:28 -04:00 |
|
Nicolas
|
2bcbe4f353
|
Create check-redis.yml
|
2024-07-16 22:47:34 -04:00 |
|
Nicolas
|
3c3412e893
|
Update rate-limiter.test.ts
|
2024-07-16 22:45:12 -04:00 |
|
Nicolas
|
ffc3b7c5fb
|
Update index.ts
|
2024-07-16 22:42:40 -04:00 |
|
Nicolas
|
c9073a747c
|
Nick:
|
2024-07-16 22:41:13 -04:00 |
|
Caleb Peffer
|
d39d3be649
|
Caleb: now extracting and returning a list of all links on the page for a customer
|
2024-07-16 18:38:03 -07:00 |
|
rafaelsideguide
|
dba1fb2dc8
|
Update removeUnwantedElements.ts
|
2024-07-16 18:22:56 -03:00 |
|
Rafael Miller
|
db0545014f
|
Merge pull request #391 from jhoseph88/feat/issue-387
[Feat] Pass along current, total, current_step, and current_url in js sdk
|
2024-07-16 15:56:42 -03:00 |
|
Nicolas
|
548c8c1f28
|
Merge pull request #417 from mendableai/nsc/seperate-rate-limit
Separate Rate Limiter from Main Redis
|
2024-07-16 10:14:08 -04:00 |
|
Nicolas
|
92202de12b
|
Update rate-limiter.ts
|
2024-07-16 10:09:49 -04:00 |
|
Nicolas
|
7f596e7a55
|
Update README.md
|
2024-07-15 23:01:40 -04:00 |
Thomas Kosmas
|
5c65ec58e5
|
Support chrome-cdp and restructure sitemap fire-engine support.
|
2024-07-15 18:40:43 +03:00 |
|
Nicolas
|
8efd444ba2
|
Merge pull request #399 from mendableai/nsc/sitemap-fix-fire-engine
Sitemap fallback fixes w/ fire-engine
|
2024-07-12 23:24:15 -04:00 |
|
Nicolas
|
949791049f
|
Nick:
|
2024-07-12 23:20:26 -04:00 |
|
Nicolas
|
d0c8d3ecde
|
Merge branch 'main' into nsc/sitemap-fix-fire-engine
|
2024-07-12 22:15:06 -04:00 |
|
Nicolas
|
a3b1703b68
|
Update fireEngine.ts
|
2024-07-12 22:15:00 -04:00 |
|
Nicolas
|
09bc2c7a9c
|
Merge pull request #394 from mendableai/nsc/small-fe-print
Log Fire-engine page errors
|
2024-07-12 22:14:04 -04:00 |
|
Nicolas
|
e098e88ea7
|
Nick:
|
2024-07-12 22:02:08 -04:00 |
|
Nicolas
|
bfc7f5882e
|
Update index.ts
|
2024-07-12 19:57:12 -04:00 |
|
Nicolas
|
da3e6525a9
|
Merge pull request #398 from mendableai/nsc/slack-alerts-1
CI for alerts instead
|
2024-07-12 19:52:34 -04:00 |
|
Nicolas
|
436e8922a7
|
Nick: doing on the ci instead
|
2024-07-12 19:49:38 -04:00 |
|
Nicolas
|
e61e94cb78
|
Merge pull request #397 from mendableai/nsc/slack-alerts-1
Slack Alerts for when queue is over capacity
|
2024-07-12 19:24:59 -04:00 |
|
Nicolas
|
fc3328f3d1
|
Update index.ts
|
2024-07-12 19:12:56 -04:00 |
|
Nicolas
|
fd18f2269b
|
Nick: slack alerts
|
2024-07-12 19:07:59 -04:00 |
|
Nicolas
|
214a6ee608
|
Merge pull request #396 from mendableai/bugfix/crawl-docker
[BUG] Fixed docker self hosting issue
|
2024-07-12 16:48:16 -04:00 |
|
rafaelsideguide
|
f453bcf17c
|
bugfix docker self hosting
|
2024-07-12 16:51:20 -03:00 |
|
Nicolas
|
f2a08e0ab8
|
Merge pull request #395 from kun432/kun432/fix-use-db-auth-check-for-selfhost
Fix USE_DB_AUTHENTICATION checks for self-host
|
2024-07-12 15:39:35 -04:00 |
|
Nicolas
|
0ddaac6ae0
|
Nick: fixed the other instances as well
|
2024-07-12 15:39:10 -04:00 |
|
Nicolas
|
5da03a8fbd
|
Update fireEngine.ts
|
2024-07-12 14:59:49 -04:00 |
Kuniaki Shimizu
|
bd986a453c
|
fix USE_DB_AUTHENTICATION checks
|
2024-07-13 03:50:46 +09:00 |
|
Nicolas
|
b5b75086c1
|
Update index.ts
|
2024-07-12 10:44:14 -04:00 |
|
Nicolas
|
c07a1912e9
|
Merge pull request #393 from mendableai/mog/job-stuck-fix
fix(bull): requeue jobs after restart
|
2024-07-12 10:43:02 -04:00 |
|
Gergo Moricz
|
0d3e09e798
|
fix: try-catch job removal
|
2024-07-12 16:35:50 +02:00 |
|
Gergő Móricz
|
69d724714f
|
Merge branch 'main' into mog/job-stuck-fix
|
2024-07-12 16:33:34 +02:00 |
|
Nicolas
|
c3eecf7b9f
|
Update index.ts
|
2024-07-12 10:22:06 -04:00 |