Commit Graph

935 Commits

Author SHA1 Message Date
Nicolas 23e3f88070
Merge pull request #83 from mendableai/website-specific-params
Specific website params support
2024-04-28 12:44:55 -07:00
Nicolas 68838c9e0d Update single_url.ts 2024-04-28 12:44:00 -07:00
Nicolas d8ee4e90d6 Update website_params.ts 2024-04-28 11:47:25 -07:00
Nicolas e6d7a4761d
Update README.md 2024-04-28 11:41:42 -07:00
Nicolas 8e44696c4d Nick: 2024-04-28 11:34:25 -07:00
Nicolas 1dc6458c6a Update crawler.ts 2024-04-27 11:17:10 -07:00
Nicolas 0f694e0608
Update crawler.ts 2024-04-27 11:14:52 -07:00
tractorjuice a5d38039f2
Add additional file extensions to crawler.ts
Add additional file extensions.
2024-04-27 11:03:27 +01:00
Nicolas fb08f28edf
Merge pull request #66 from mendableai/feat/coupons
[Feat] Coupon system
2024-04-26 14:50:57 -07:00
Nicolas 7689c31d35 Update credit_billing.ts 2024-04-26 14:36:19 -07:00
Nicolas 0a607b9efa Merge branch 'main' into feat/coupons 2024-04-26 14:23:35 -07:00
Eric Ciarla 6cf147f5ec Contradictions tutorial 2024-04-26 16:56:22 -04:00
Nicolas fdd3b704f7
Update README.md 2024-04-26 13:37:00 -07:00
Nicolas fdf913e0f1 Update index.test.ts 2024-04-26 13:06:48 -07:00
Nicolas 8e32453424 Update auth.ts 2024-04-26 12:57:49 -07:00
rafaelsideguide 1f48998970 done 2024-04-26 16:27:31 -03:00
Nicolas ebd9be3d9c
Merge pull request #68 from mdp/mdp/dotenv_jest
[Bugfix] JS-SDK: Remove dotenv and add tests
2024-04-26 11:29:22 -07:00
Nicolas bb3da8df89 Update package.json 2024-04-26 11:28:31 -07:00
Nicolas df96fade42 Merge branch 'main' into pr/68 2024-04-26 11:28:28 -07:00
Nicolas 26f75a59c3
Merge pull request #75 from mendableai/nsc/free-credits-increase
Free credits increase
2024-04-26 10:27:00 -07:00
Nicolas d210a57a9b Update credit_billing.ts 2024-04-26 10:24:36 -07:00
Nicolas 24e1bdec1b Update credit_billing.ts 2024-04-26 10:14:29 -07:00
rafaelsideguide 06675d1fe3 almost finished 2024-04-26 11:42:49 -03:00
Nicolas f368e94cee
Merge branch 'main' into mdp/dotenv_jest 2024-04-25 17:59:20 -07:00
Nicolas 4fce848ebb Update README.md 2024-04-25 13:29:37 -07:00
Nicolas 3ac8724329 Update openapi.json 2024-04-25 13:28:07 -07:00
Nicolas fb0301c1db
Merge pull request #72 from mendableai/nsc/search-js-sdk
/search support in node sdk
2024-04-25 13:07:00 -07:00
Nicolas b7c7291b0e Nick: v15 2024-04-25 12:49:10 -07:00
Nicolas a32e16a9be Nick: added /search to the python sdk 2024-04-25 11:20:35 -07:00
rafaelsideguide 6ea818fac8 Update version 2024-04-25 14:49:12 -03:00
Nicolas f2af7408e8 Update main.py 2024-04-25 10:31:28 -07:00
Nicolas a3911bfc67 Update index.ts 2024-04-25 10:00:35 -07:00
Rafael Miller 03d1c64ac8
Removed process.env call for API_KEY 2024-04-25 13:33:06 -03:00
Mark Percival e8b8150b56 Chore: Add some basic jest tests 2024-04-25 14:30:33 +00:00
Mark Percival a7be09e479 Fix: Remove dotenv from npm module 2024-04-25 14:16:14 +00:00
rafaelsideguide d3ab2ea926 [Feat] Implemented retry attempts to handle 502 errors 2024-04-25 10:51:01 -03:00
rafaelsideguide 9c481e5e83 [Feat] Coupon system
WIP. Idea for solving #57
2024-04-25 10:05:53 -03:00
Rafael Miller abf6918642
Merge pull request #64 from mendableai/feat/allowed-urls
[Feat] Added allowed urls
2024-04-25 08:43:16 -03:00
rafaelsideguide 75597f72a1 [Feat] Added allowed urls
FireCrawl should be able to scrape LinkedIn Articles (/pulse/*)
2024-04-25 08:39:45 -03:00
Nicolas 75e82869ed
Merge pull request #62 from mendableai/nsc/serper-params
Serper params
2024-04-24 18:13:30 -07:00
Nicolas a59ddf1855 Nick: default to serper 2024-04-24 18:00:25 -07:00
Roger M f2690f6909 Support for tbs, filter, lang, country and location with Serper search. 2024-04-25 01:35:17 +01:00
Nicolas 26c861db5a
Update README.md 2024-04-24 16:13:29 -07:00
Nicolas d0a70de062
Update README.md 2024-04-24 11:46:25 -07:00
Nicolas 427f658c44
Update README.md 2024-04-24 10:40:07 -07:00
Nicolas e7d385ad32 Update search.ts 2024-04-24 10:23:26 -07:00
Nicolas 3d18f2f7a0 Update README.md 2024-04-24 10:16:23 -07:00
Nicolas 877af4231b Update openapi.json 2024-04-24 10:11:44 -07:00
Nicolas 307ea6f5ec Nick: improvements to search 2024-04-24 10:11:01 -07:00
Rafael Miller f189589da4
Merge pull request #34 from mendableai/nsc/returnOnlyUrls
Implements the ability for the crawler to output all the links it found, without scraping
2024-04-24 10:34:42 -03:00