Skip to content

Commit e404f4f

Browse files
prakriti-solankeypraveshkumar1988kaustubh-darekarvishnu-chibhade99kartikpersistent
authored
Dev to staging fresh code (#1507)
* Add cloudbuild.yaml for backend deployment and environment detection * Fix syntax error and improve variable interpolation in cloudbuild.yaml * Fix variable interpolation in backend deployment commands in cloudbuild.yaml * Fix variable interpolation in backend deployment commands in cloudbuild.yaml * logic refined for write access to db (#1448) * Enhance cloudbuild.yaml to support additional deployment environments and improve environment variable handling * Staging (#1450) * Dev to Staging (#1443) * removed unused neo4j-driver * added auth0 in the frame src * message change * Update docker-compose.yml * Bump tailwindcss from 3.4.9 to 4.0.6 in /frontend (#1091) Bumps [tailwindcss](https://github.com/tailwindlabs/tailwindcss/tree/HEAD/packages/tailwindcss) from 3.4.9 to 4.0.6. - [Release notes](https://github.com/tailwindlabs/tailwindcss/releases) - [Changelog](https://github.com/tailwindlabs/tailwindcss/blob/main/CHANGELOG.md) - [Commits](https://github.com/tailwindlabs/tailwindcss/commits/v4.0.6/packages/tailwindcss) --- updated-dependencies: - dependency-name: tailwindcss dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * message check * V0.7.1 documentation updates (#1094) * updated the frontend env variables * added deepseek * model updates * Update README.md * Add env variable description in read.me * Additional Instructions * Update frontend_docs.adoc * added helper text format fixes --------- Co-authored-by: Prakriti Solankey <156313631+prakriti-solankey@users.noreply.github.com> Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * Bump react-dropzone from 14.2.3 to 14.3.5 in /frontend (#1084) Bumps [react-dropzone](https://github.com/react-dropzone/react-dropzone) from 14.2.3 to 14.3.5. - [Release notes](https://github.com/react-dropzone/react-dropzone/releases) - [Commits](https://github.com/react-dropzone/react-dropzone/compare/v14.2.3...v14.3.5) --- updated-dependencies: - dependency-name: react-dropzone dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump @typescript-eslint/eslint-plugin from 6.21.0 to 7.0.0 in /frontend (#1083) Bumps [@typescript-eslint/eslint-plugin](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/eslint-plugin) from 6.21.0 to 7.0.0. - [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases) - [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/eslint-plugin/CHANGELOG.md) - [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v7.0.0/packages/eslint-plugin) --- updated-dependencies: - dependency-name: "@typescript-eslint/eslint-plugin" dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump eslint-plugin-react-hooks from 4.6.2 to 5.1.0 in /frontend (#1082) Bumps [eslint-plugin-react-hooks](https://github.com/facebook/react/tree/HEAD/packages/eslint-plugin-react-hooks) from 4.6.2 to 5.1.0. - [Release notes](https://github.com/facebook/react/releases) - [Changelog](https://github.com/facebook/react/blob/main/CHANGELOG.md) - [Commits](https://github.com/facebook/react/commits/HEAD/packages/eslint-plugin-react-hooks) --- updated-dependencies: - dependency-name: eslint-plugin-react-hooks dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump typescript from 5.5.4 to 5.7.3 in /frontend (#1081) Bumps [typescript](https://github.com/microsoft/TypeScript) from 5.5.4 to 5.7.3. - [Release notes](https://github.com/microsoft/TypeScript/releases) - [Changelog](https://github.com/microsoft/TypeScript/blob/main/azure-pipelines.release.yml) - [Commits](https://github.com/microsoft/TypeScript/compare/v5.5.4...v5.7.3) --- updated-dependencies: - dependency-name: typescript dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * fix-additional-instructions (#1089) * V0.7.1 minor fixes (#1097) * Minor bug fixes * fixed Ui changes for disable sources in non connected state --------- Co-authored-by: Prakriti Solankey <156313631+prakriti-solankey@users.noreply.github.com> * remove try except from llm.py * Remove example.env from main folder (#1099) * moved to taulwind 3 * tailwind 4 migration * format fixes * Source list api convert to post (#1102) * Convert source_list from get to post * changed to post method --------- Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * height issue * fix: Profile CSS Fix * fix: display flex issue fix * Update dependabot.yml (#1122) frequency_change_for_package_updates * added automated linting and formatting through husky hooks * renamed the files * husky setup fix * added permission * test commiy * type checking through husky hooks * something bad code * some bad code * some bad code * testing pre-commit code * testing pre-commit code * lint setup on staged commits * test commt * test commit with errors * fix * added pypandoc-binary package for OSError: No pandoc was found during extraction of doc files (#1124) * added document plus icon * Bump axios from 1.7.3 to 1.7.9 in /frontend (#1113) Bumps [axios](https://github.com/axios/axios) from 1.7.3 to 1.7.9. - [Release notes](https://github.com/axios/axios/releases) - [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md) - [Commits](https://github.com/axios/axios/compare/v1.7.3...v1.7.9) --- updated-dependencies: - dependency-name: axios dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump eslint-plugin-react-refresh from 0.4.9 to 0.4.19 in /frontend (#1112) Bumps [eslint-plugin-react-refresh](https://github.com/ArnaudBarre/eslint-plugin-react-refresh) from 0.4.9 to 0.4.19. - [Release notes](https://github.com/ArnaudBarre/eslint-plugin-react-refresh/releases) - [Changelog](https://github.com/ArnaudBarre/eslint-plugin-react-refresh/blob/main/CHANGELOG.md) - [Commits](https://github.com/ArnaudBarre/eslint-plugin-react-refresh/compare/v0.4.9...v0.4.19) --- updated-dependencies: - dependency-name: eslint-plugin-react-refresh dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump postcss from 8.4.41 to 8.5.3 in /frontend (#1114) Bumps [postcss](https://github.com/postcss/postcss) from 8.4.41 to 8.5.3. - [Release notes](https://github.com/postcss/postcss/releases) - [Changelog](https://github.com/postcss/postcss/blob/main/CHANGELOG.md) - [Commits](https://github.com/postcss/postcss/compare/8.4.41...8.5.3) --- updated-dependencies: - dependency-name: postcss dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump react-icons from 5.2.1 to 5.5.0 in /frontend (#1115) Bumps [react-icons](https://github.com/react-icons/react-icons) from 5.2.1 to 5.5.0. - [Release notes](https://github.com/react-icons/react-icons/releases) - [Commits](https://github.com/react-icons/react-icons/compare/v5.2.1...v5.5.0) --- updated-dependencies: - dependency-name: react-icons dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * different url web page having same title issue fixed (#1110) * Text file encoding issue (#1126) * Resolved UnicodeDecodeError for some txt files * changes done to process utf-8 file with unstructured only * Resolved UnicodeDecodeError issue for files having other than utf-8 encoding (#1128) * Resolved UnicodeDecodeError for some txt files * changes done to process utf-8 file with unstructured only * ensure file path is correct and as per intended format to avoid security risks * Sanitizing additional instruction (#1130) * resolved UnboundLocalError: local variable 'graphDb_data_Access' referenced before assignment (#1129) * connection not there message for data resources (#1131) * dockerfile updates and utils functions change * fix: readonly issue fix * Resolved uploaded file extraction failing on deployed version (#1136) * UI fixes v0.7.2 (#1138) * UI fixes * dropdown option fix * Message Overlay and button size fixes * select components size change from large to small post package update (#1135) * connection status check * connection check update * fix * added dropdown for graph visulization * fixes: added explore icon fixed responsivness issue * document_status api fix --------- Co-authored-by: Prakriti Solankey <156313631+prakriti-solankey@users.noreply.github.com> * Update BreakDownPopOver.tsx * chunk_count_val * type error * spell fixes and protected route fixes * top entities not found - bug resolved (#1150) * top entities not fpund bug resolved * refined code * limiting content fetching to current wikipedia page (#1151) * added the link for login redirectig * removed loading statw * added the padding and changed the message * Bump re-resizable from 6.9.17 to 6.11.2 in /frontend (#1149) Bumps [re-resizable](https://github.com/bokuweb/react-resizable-box) from 6.9.17 to 6.11.2. - [Release notes](https://github.com/bokuweb/react-resizable-box/releases) - [Changelog](https://github.com/bokuweb/re-resizable/blob/master/CHANGELOG.md) - [Commits](https://github.com/bokuweb/react-resizable-box/commits) --- updated-dependencies: - dependency-name: re-resizable dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump eslint-plugin-react from 7.35.0 to 7.37.4 in /frontend (#1148) Bumps [eslint-plugin-react](https://github.com/jsx-eslint/eslint-plugin-react) from 7.35.0 to 7.37.4. - [Release notes](https://github.com/jsx-eslint/eslint-plugin-react/releases) - [Changelog](https://github.com/jsx-eslint/eslint-plugin-react/blob/master/CHANGELOG.md) - [Commits](https://github.com/jsx-eslint/eslint-plugin-react/compare/v7.35.0...v7.37.4) --- updated-dependencies: - dependency-name: eslint-plugin-react dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump @types/node from 20.14.14 to 22.13.9 in /frontend (#1152) Bumps [@types/node](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/node) from 20.14.14 to 22.13.9. - [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases) - [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/node) --- updated-dependencies: - dependency-name: "@types/node" dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump eslint-config-prettier from 8.10.0 to 10.0.2 in /frontend (#1146) Bumps [eslint-config-prettier](https://github.com/prettier/eslint-config-prettier) from 8.10.0 to 10.0.2. - [Release notes](https://github.com/prettier/eslint-config-prettier/releases) - [Changelog](https://github.com/prettier/eslint-config-prettier/blob/main/CHANGELOG.md) - [Commits](https://github.com/prettier/eslint-config-prettier/compare/v8.10.0...v10.0.2) --- updated-dependencies: - dependency-name: eslint-config-prettier dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump react-dropzone from 14.3.5 to 14.3.8 in /frontend (#1145) Bumps [react-dropzone](https://github.com/react-dropzone/react-dropzone) from 14.3.5 to 14.3.8. - [Release notes](https://github.com/react-dropzone/react-dropzone/releases) - [Commits](https://github.com/react-dropzone/react-dropzone/compare/v14.3.5...v14.3.8) --- updated-dependencies: - dependency-name: react-dropzone dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Update dependabot.yml * Update the query to check DB is gds version (#1153) * Entity details shown for entity mode (#1154) * bracket missing * fix: auth 0 fix * fixes (#1170) * Bump @neo4j-nvl/react from 0.3.6 to 0.3.7 in /frontend (#1163) Bumps [@neo4j-nvl/react](https://neo4j.com/docs/nvl/current/) from 0.3.6 to 0.3.7. --- updated-dependencies: - dependency-name: "@neo4j-nvl/react" dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump @tailwindcss/postcss from 4.0.7 to 4.0.12 in /frontend (#1162) Bumps [@tailwindcss/postcss](https://github.com/tailwindlabs/tailwindcss/tree/HEAD/packages/@tailwindcss-postcss) from 4.0.7 to 4.0.12. - [Release notes](https://github.com/tailwindlabs/tailwindcss/releases) - [Changelog](https://github.com/tailwindlabs/tailwindcss/blob/main/CHANGELOG.md) - [Commits](https://github.com/tailwindlabs/tailwindcss/commits/v4.0.12/packages/@tailwindcss-postcss) --- updated-dependencies: - dependency-name: "@tailwindcss/postcss" dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Bump prettier from 2.8.8 to 3.5.3 in /frontend (#1161) Bumps [prettier](https://github.com/prettier/prettier) from 2.8.8 to 3.5.3. - [Release notes](https://github.com/prettier/prettier/releases) - [Changelog](https://github.com/prettier/prettier/blob/main/CHANGELOG.md) - [Commits](https://github.com/prettier/prettier/compare/2.8.8...3.5.3) --- updated-dependencies: - dependency-name: prettier dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump @types/node from 22.13.9 to 22.13.10 in /frontend (#1160) Bumps [@types/node](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/node) from 22.13.9 to 22.13.10. - [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases) - [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/node) --- updated-dependencies: - dependency-name: "@types/node" dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump axios from 1.7.9 to 1.8.2 in /frontend (#1159) Bumps [axios](https://github.com/axios/axios) from 1.7.9 to 1.8.2. - [Release notes](https://github.com/axios/axios/releases) - [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md) - [Commits](https://github.com/axios/axios/compare/v1.7.9...v1.8.2) --- updated-dependencies: - dependency-name: axios dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * gitignore changes * border missing for graph * openai 4.5 and claude 3.7 added (#1181) * Handled deadlock errors in executing cypher query (#1187) * Updating dependencies (#1189) * updated dependencies * Updated code according to langchain-neo4j latest version * updating node & rel count in between extraction process (#1191) * fix: Database name not being passed * added generic type for queue * Fix : default value of function param * log the info only when last chunk uploaded and merge the file * Product tour v1 (#1186) * added product tour v1 * typo fixes * spotlight target changes * tour including login flow * Tour for small screens * Queue remove method updates * added firsttime user check * tour fix for auth disabled scenario * removed unused code * conditions updates * Selection dropdown (#1217) * Schema Relationship UI change * state change management * backend-changes * highlight recently added val * schema modal * state-management-of-all-three-views * merging all patterns, nodes and rels * merged all nodes and rels * formatting allowed relationships in tuple for LLMGraphTransformer * scheme add new values to list * code removal * local storage update --------- Co-authored-by: kaustubh-darekar <kaustubh_darekar@persistent.com> Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * lint fixes * changes * lint issues * Bump @mui/styled-engine from 5.16.6 to 7.0.1 in /frontend (#1209) Bumps [@mui/styled-engine](https://github.com/mui/material-ui/tree/HEAD/packages/mui-styled-engine) from 5.16.6 to 7.0.1. - [Release notes](https://github.com/mui/material-ui/releases) - [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md) - [Commits](https://github.com/mui/material-ui/commits/v7.0.1/packages/mui-styled-engine) --- updated-dependencies: - dependency-name: "@mui/styled-engine" dependency-version: 7.0.1 dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump eslint-config-prettier from 10.0.2 to 10.1.1 in /frontend (#1208) Bumps [eslint-config-prettier](https://github.com/prettier/eslint-config-prettier) from 10.0.2 to 10.1.1. - [Release notes](https://github.com/prettier/eslint-config-prettier/releases) - [Changelog](https://github.com/prettier/eslint-config-prettier/blob/main/CHANGELOG.md) - [Commits](https://github.com/prettier/eslint-config-prettier/compare/v10.0.2...v10.1.1) --- updated-dependencies: - dependency-name: eslint-config-prettier dependency-version: 10.1.1 dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump uuid from 9.0.1 to 11.1.0 in /frontend (#1207) Bumps [uuid](https://github.com/uuidjs/uuid) from 9.0.1 to 11.1.0. - [Release notes](https://github.com/uuidjs/uuid/releases) - [Changelog](https://github.com/uuidjs/uuid/blob/main/CHANGELOG.md) - [Commits](https://github.com/uuidjs/uuid/compare/v9.0.1...v11.1.0) --- updated-dependencies: - dependency-name: uuid dependency-version: 11.1.0 dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump axios from 1.8.3 to 1.8.4 in /frontend (#1206) Bumps [axios](https://github.com/axios/axios) from 1.8.3 to 1.8.4. - [Release notes](https://github.com/axios/axios/releases) - [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md) - [Commits](https://github.com/axios/axios/compare/v1.8.3...v1.8.4) --- updated-dependencies: - dependency-name: axios dependency-version: 1.8.4 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump lint-staged from 15.4.3 to 15.5.0 in /frontend (#1205) Bumps [lint-staged](https://github.com/lint-staged/lint-staged) from 15.4.3 to 15.5.0. - [Release notes](https://github.com/lint-staged/lint-staged/releases) - [Changelog](https://github.com/lint-staged/lint-staged/blob/main/CHANGELOG.md) - [Commits](https://github.com/lint-staged/lint-staged/compare/v15.4.3...v15.5.0) --- updated-dependencies: - dependency-name: lint-staged dependency-version: 15.5.0 dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Gemini 2.5 model addition (#1221) * gemini 2.5 pro model added * Added gemini 2.5 pro * Updating source node for failed upload file (#1222) * Llama4 model addition (#1223) * llama4 maverick instruct basic model added * Llama4 format changed * Update README.md * Update README.md * Update README.md * Update requirements.txt * New fixes (#1224) * margin count alignment dialog onClose fixes * dropdown and pattern visibility * added dropdown button for schema * fixes * format issues * Lint fixes * persist state --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Update README.md * New fixes (#1228) * margin count alignment dialog onClose fixes * dropdown and pattern visibility * added dropdown button for schema * fixes * format issues * Lint fixes * persist state * schema changed for existing example schema * remove and update nodes * missed emptying the value * nodes labels changes * getting schema from text changes done --------- Co-authored-by: Prakriti Solankey <156313631+prakriti-solankey@users.noreply.github.com> Co-authored-by: kaustubh-darekar <kaustubh_darekar@persistent.com> * lint fixes * type fix * Updated backend dependencies (#1225) * Graph schema option (#1230) * margin count alignment dialog onClose fixes * dropdown and pattern visibility * added dropdown button for schema * fixes * format issues * Lint fixes * options * graph schema --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Bump json-repair from 0.30.3 to 0.40.0 in /backend (#1203) Bumps [json-repair](https://github.com/mangiucugna/json_repair) from 0.30.3 to 0.40.0. - [Release notes](https://github.com/mangiucugna/json_repair/releases) - [Commits](https://github.com/mangiucugna/json_repair/compare/v0.30.3...v0.40.0) --- updated-dependencies: - dependency-name: json-repair dependency-version: 0.40.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * models change * Update Backend API doc * Update README.md * Added log statement to check which database it creates source node (#1232) * New models addition (#1233) * new models of openai and fireworks llama4 added * removing gpt 4.5 from models, * version conflict of json repair package with langchain_neo4j and neo4j graphrag package (#1234) * Schema render (#1235) * fixed schema change * Update frontend/src/utils/Utils.ts Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * removed duplicate triples * schema-deduplicate --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Integration test formatting updates (#1237) * integration test script updated * Updated script for better formatting results * code reform * integration test updated * added plugins for markdown * bug: removed gcs as default source * fix: build error * Error fixed : local variable 'file_name' referenced before assignment * Fix: Rerendering fix of Filetable * fix: Rerendering fix by function Memoization * Update README.md * Update README.md * fix: accessibility-fixes * Vector index exist (#1249) * vector index already exist error handled * error fixed * Validation for tuple schema (#1248) * deleted unused files * validation for schema select dropdown * fix: hooks order mismatch * drawer useCallback fix * labels change * fix: unnecessary use of useEffect * moving out the common funtion * removed useEffect * fix: Schema Statemanagement issue * edge case * Bump eslint-plugin-react-refresh from 0.4.19 to 0.4.20 in /frontend (#1266) Bumps [eslint-plugin-react-refresh](https://github.com/ArnaudBarre/eslint-plugin-react-refresh) from 0.4.19 to 0.4.20. - [Release notes](https://github.com/ArnaudBarre/eslint-plugin-react-refresh/releases) - [Changelog](https://github.com/ArnaudBarre/eslint-plugin-react-refresh/blob/main/CHANGELOG.md) - [Commits](https://github.com/ArnaudBarre/eslint-plugin-react-refresh/compare/v0.4.19...v0.4.20) --- updated-dependencies: - dependency-name: eslint-plugin-react-refresh dependency-version: 0.4.20 dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump tailwindcss from 4.0.12 to 4.1.5 in /frontend (#1265) Bumps [tailwindcss](https://github.com/tailwindlabs/tailwindcss/tree/HEAD/packages/tailwindcss) from 4.0.12 to 4.1.5. - [Release notes](https://github.com/tailwindlabs/tailwindcss/releases) - [Changelog](https://github.com/tailwindlabs/tailwindcss/blob/main/CHANGELOG.md) - [Commits](https://github.com/tailwindlabs/tailwindcss/commits/v4.1.5/packages/tailwindcss) --- updated-dependencies: - dependency-name: tailwindcss dependency-version: 4.1.5 dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump @mui/styled-engine from 7.0.1 to 7.0.2 in /frontend (#1264) Bumps [@mui/styled-engine](https://github.com/mui/material-ui/tree/HEAD/packages/mui-styled-engine) from 7.0.1 to 7.0.2. - [Release notes](https://github.com/mui/material-ui/releases) - [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md) - [Commits](https://github.com/mui/material-ui/commits/v7.0.2/packages/mui-styled-engine) --- updated-dependencies: - dependency-name: "@mui/styled-engine" dependency-version: 7.0.2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump @types/uuid from 9.0.8 to 10.0.0 in /frontend (#1263) Bumps [@types/uuid](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/uuid) from 9.0.8 to 10.0.0. - [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases) - [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/uuid) --- updated-dependencies: - dependency-name: "@types/uuid" dependency-version: 10.0.0 dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump @emotion/styled from 11.13.0 to 11.14.0 in /frontend (#1262) Bumps [@emotion/styled](https://github.com/emotion-js/emotion) from 11.13.0 to 11.14.0. - [Release notes](https://github.com/emotion-js/emotion/releases) - [Changelog](https://github.com/emotion-js/emotion/blob/main/CHANGELOG.md) - [Commits](https://github.com/emotion-js/emotion/compare/@emotion/styled@11.13.0...@emotion/styled@11.14.0) --- updated-dependencies: - dependency-name: "@emotion/styled" dependency-version: 11.14.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * removed the help text * title: fix for small layouts * fix: gcs,s3 source check * minimize the docker file size using torch CPU version (#1246) * Add constaints file to install torch CPU version * Docker file issue fixed * '-f' option specifying at the beginning of the file so that it applies to all package specifications. * Removing PART_OF relationship from exluded list because excluded nodes already excude infrastructure nodes * Removed HAS_ENTITY from excude relatioship list * Dropdown update (#1272) * dropdown change * state changes * removed the unused imports * state change * updates all states * moved values outside * checked nodes and rels * remove on disconnect --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Update the query to get relationship patterns (#1276) * Update the query to get relationship patterns * patterns exclusion handled at code level --------- Co-authored-by: kaustubh-darekar <kaustubh_darekar@persistent.com> * llama4 , qwen models added (#1277) * loaded .env file to override the env variables set at shell level. (#1278) * buf fixed * fix: missing import * passed session parameters to avoid race condition (#1283) * added database * code changes done to get model name from llm to condition ignore tool usage behaviour (#1286) * added allowednodes and relationship in logs while error logging * added validation for tuple schema relationships (#1289) * Allowed nodes validation (#1290) * added validation for tuple schema relationships * remove duplicate --------- Co-authored-by: kaustubh-darekar <kaustubh_darekar@persistent.com> * data importer with format fixes (#1301) * data importer with format fixes * Update frontend/src/components/Layout/PageLayout.tsx Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fomrat issues * heading name change * Update frontend/src/components/Layout/PageLayout.tsx Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * name correction --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * updated dependencies (#1321) * new claude sonnet model added (#1299) * added fireworks-ai package specific version to solve protobuf issue (#1323) * Bump @vitejs/plugin-react from 4.3.1 to 4.5.0 in /frontend (#1313) Bumps [@vitejs/plugin-react](https://github.com/vitejs/vite-plugin-react/tree/HEAD/packages/plugin-react) from 4.3.1 to 4.5.0. - [Release notes](https://github.com/vitejs/vite-plugin-react/releases) - [Changelog](https://github.com/vitejs/vite-plugin-react/blob/main/packages/plugin-react/CHANGELOG.md) - [Commits](https://github.com/vitejs/vite-plugin-react/commits/plugin-react@4.5.0/packages/plugin-react) --- updated-dependencies: - dependency-name: "@vitejs/plugin-react" dependency-version: 4.5.0 dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump @mui/styled-engine from 7.0.2 to 7.1.0 in /frontend (#1312) Bumps [@mui/styled-engine](https://github.com/mui/material-ui/tree/HEAD/packages/mui-styled-engine) from 7.0.2 to 7.1.0. - [Release notes](https://github.com/mui/material-ui/releases) - [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md) - [Commits](https://github.com/mui/material-ui/commits/v7.1.0/packages/mui-styled-engine) --- updated-dependencies: - dependency-name: "@mui/styled-engine" dependency-version: 7.1.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump @neo4j-nvl/react from 0.3.7 to 0.3.8 in /frontend (#1310) Bumps [@neo4j-nvl/react](https://neo4j.com/docs/nvl/current/) from 0.3.7 to 0.3.8. --- updated-dependencies: - dependency-name: "@neo4j-nvl/react" dependency-version: 0.3.8 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * example env changed for gemini 2.5 pro * removed unused code * sentenceTransformar embedding model download locally to use (#1361) * sentenceTransformar embedding model download locally to use * Added command in docker to download the embedding model once docker up * FIx the docker issue * download nltk punkt from docker * env fetching changes * Added library in docker * Remove Duplicate import --------- Co-authored-by: kaustubh-darekar <kaustubh_darekar@persistent.com> * duplicate values * fix: remove duplicate values in dropdown options - Added deduplication utility function to prevent duplicate entries - Enhanced cross-pollination between source and target options - Added one-time cleanup effect to remove existing duplicates - Fixed ESLint errors (console.log and multiple statements per line) * fix: improve NLTK resource handling and logging in GCS document retri… (#1395) * fix: improve NLTK resource handling and logging in GCS document retrieval * fix: streamline NLTK resource downloading and path management in GCS document retrieval * chore: apply @neo4j-ndl codemod and update dependencies (#1407) * Staging code to Main (#1329) * Dev to staging (#1070) * Read only mode for unauthenticated users (#1046) * llm name changes * build fix * default mode fix * ragas model names update * lint fixes * Chunk Entities API condition * added the tooltip for unsupported lllms for ragas metric loading * removed unused imports * multimode fix when we get error response * mode changes for score display * fix: Fixed the details state handling between multiple chats feature: Added the warning banner If selected llm model is not supported for raga's evaluation * Fix: Entity Mode Width Fix * diffbot fix for async (#797) * Minor changes (#798) * added congig variable for default diffbot chat model * fulltext index creation is skipped when the labels are empty * entity vector change * added optinal to communities for entity mode * updated the entity query --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * New: Added the supported llm models for ragas evaluation * Fix: Communitites Tab is displayed based communitites length * added the conversation download button (#800) * model name correction * chatmode switch mode fix * Add API payload GCP logging (#805) * Adding Links to get neighboring nodes (#796) * addition of link * added neighbours query * implemented with driver * updated the query * communitiesInfo name change * communities.tsx removed * api integration * modified response * entities change * chunk and communities * chunk space removal * added element id to chunks * loading on click * format changes * added file name for Dcoumrnt node * chat token cut off model name update * icon change * duplicate sources removal * Entity change --------- Co-authored-by: vasanthasaikalluri <165021735+vasanthasaikalluri@users.noreply.github.com> * added error message for doc retriver (#807) * copy row (#803) * copy row * column for copy * column copy * Raga's Evaluation For Multi Modes (#806) * Updatedmodels for ragas eval * context utilization metrics removed * updated supported llms for ragas * removed context utilization * Implemented Parallel API * multi api calls error resolved * MultiMode Metrics * Fix: Metric Evalution For Single Mode * multi modes ragas evaluation * api payload changes * metric api output format changed * multi mode ragas changes * removed pre process dataset * api response changes * Multimode metrics api integration * nan error for no answer resolved * QA integration changes --------- Co-authored-by: kaustubh-darekar <kaustubh_darekar@persistent.com> * lint fixes * fix: multimode metrics state handling fix: lint fixes * fix: Multimode metrics mode change state issue fix: chunk list style issue * fix: list style fix * Correct TYPO mistake * added new env for ragas embedding model * Props name changes (#811) * Props name changes * removed the accesstoken from row on copy action * props changes for dropzone component * graph view changes --------- Co-authored-by: Prakriti Solankey <156313631+prakriti-solankey@users.noreply.github.com> * test * view graph * nodes count and relationshipcount updation fix * sourceUrl Fix * empty string "" fix to keep the default values we should keep the value blank instead "" * prop changes * props changes * retry condition update for failed files (#820) * Chat modes name changes (#815) * Props name changes * removed the accesstoken from row on copy action * updated chat mode names * Chat Modes Name Changes * lint fixes * using readble format In UI * removal of size to avoid console warning * key add --------- Co-authored-by: vasanthasaikalluri <165021735+vasanthasaikalluri@users.noreply.github.com> Co-authored-by: Prakriti Solankey <156313631+prakriti-solankey@users.noreply.github.com> * Youtube transcript fix with proxy (#822) * update script for async func * ragas changes for graph retrieval mode. context added in api output (#825) * Remove extract latency from logging and add LIMIT in duplicate nodes * Document updates (#828) * document updated with ragas evaluation information * formatting changes * chatbot api documentation updated * api details added in document * function name changed for drop create vector index api * Update README.md * updated api structire in docs (#827) * Update backend_docs.adoc * 821 llm model listing (#823) * added logic for document filters * LLM models * message change * link added * removed the text --------- Co-authored-by: vasanthasaikalluri <165021735+vasanthasaikalluri@users.noreply.github.com> * Exclude session lable node from duplicate nodes list * Added the tooltip for disabled llm option (#835) * node size changes * mode removal of rows check * formatting * Exclude __Entity__ node label from duplicate node list * Update README.md * Update README.md * Update README.md * Update README.md * fixed the youtube link * Security header and GZIPMiddleware (#847) * Added security header all API * Add GZipMiddleware * Chunk Text Details (#850) * Community title added * Added api for fetching chunk text details * output format changed for chunk text * integrated the service layer for chunkdata * added the chunks * formatting output of llm call for title generation * formatting llm output for title generation * added flex row * Changes related to pagination of fetch chunk api * Integrated the pagination * page changes error resolved for fetch chunk api * for get neighbours api , community title added in properties * moving community title related changes to separate branch * Removed Query module from fastapi import statement * icon changes --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Communities Id to Title (#851) * Staging to main (#735) * Dev (#537) * format fixes and graph schema indication fix * Update README.md * added chat modes variable in env updated the readme * spell fix * added the chat mode in env table * added the logos * fixed the overflow issues * removed the extra fix * Fixed specific scenario "when the text from schema closes it should reopen the previous modal" * readme changes * removed dev console logs * added new retrieval query (#533) * format fixes and tab rendering fix * fixed the setting modal reopen issue --------- Co-authored-by: Prakriti Solankey <156313631+prakriti-solankey@users.noreply.github.com> Co-authored-by: vasanthasaikalluri <165021735+vasanthasaikalluri@users.noreply.github.com> * disabled the sumbit buttom on loading * Deduplication tab (#566) * de-duplication API * Update De-Duplicate query * created the Deduplication tab * added the API service * added the removeable tags for similar nodes in deduplication tab * Integrate Tag * added GraphLabel * added loader state * added the merge service * integrated the merge API * Merge Query issue fixed * Auto refresh the duplicate nodes after merging operation * added the description for de duplication * reset on merging --------- Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * Update frontend_docs.adoc (#538) * Update frontend_docs.adoc * doc update * Images * Images folder change * Images folder change * test image * Update frontend_docs.adoc * image change * Update frontend_docs.adoc * Update frontend_docs.adoc * added the Graph Mode SS * added the Query SS * Update frontend_docs.adoc * conflics fix * conflict fix * Update frontend_docs.adoc --------- Co-authored-by: aashipandya <156318202+aashipandya@users.noreply.github.com> Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * updated langchain versions (#565) * Update the De-Duplication query * Node relationship id type none issue (#547) * de-duplication API * Update De-Duplicate query * Issue fixed Nodes,Relationship Id and Type None or Blank * added the tooltips * type fix * Unneccory import * added score threshold and added some error handling (#571) * Update requirements.txt * Tooltip and other UI fixes (#572) * Staging To Main (#495) * Integration_qa test (#375) * Test IntegrationQA added * update test cases * update test * update node count assertions * test changes * update changes * modification test * Code refatctor test cases * Handle allowedlist issue in test * test changes * update test * test case execution * test chatbot updates * test case update file * added file --------- Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * recent merges * pdf deletion due to out of diskspace * fixed status blank issue * Rendering the file name instead of link for gcs and s3 sources in the info modal * Convert is_cancelled value from string to bool * added the default page size * Issue fixed Processed chunked as 0 when file re-process again * Youtube timestamps (#386) * Wikipedia source to accept all valid urls * wikipedia url to support multiple languages * integrated wiki langauge param for extract api * Youtube video timestamps --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * groq llm integration backend (#286) * groq llm integration backend * groq and description in node properties * added groq in options --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * offset in chunks (#389) * page number in gcs loader (#393) * added youtube timestamps (#392) * chat pop up button (#387) * expand * minimize-icon * css changes * chat history * chatbot wider Side Nav * expand icon * chatbot UI * Delete * merge fixes * code suggestions --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * chunks create before extraction using is_pre_process variable (#383) * chunks create before extraction using is_pre_process variable * Return total pages for Model * update requirement.txt * total pages on uplaod API * added the Confirmation Dialog * added the selected files into the confirmation modal * format and lint fixes * added the stop watch image * fileselection on alert dialog * Add timeout in docker for gunicorn workers * Add cancel icon to info popup (#384) * Info Modal Changes * css changes * recent merges * Integration_qa test (#375) * Test IntegrationQA added * update test cases * update test * update node count assertions * test changes * update changes * modification test * Code refatctor test cases * Handle allowedlist issue in test * test changes * update test * test case execution * test chatbot updates * test case update file * added file --------- Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * fixed status blank issue * Rendering the file name instead of link for gcs and s3 sources in the info modal * added the default page size * Convert is_cancelled value from string to bool * Issue fixed Processed chunked as 0 when file re-process again * Youtube timestamps (#386) * Wikipedia source to accept all valid urls * wikipedia url to support multiple languages * integrated wiki langauge param for extract api * Youtube video timestamps --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * groq llm integration backend (#286) * groq llm integration backend * groq and description in node properties * added groq in options --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Save Total Pages in DB * Added total Pages * file selection when we didn't select anything from Main table * added the danger icon only for large files * added the overflow for more files and file selection for all new files * moved the interface to types * added the icon accoroding to the source * set total page for wiki and youtube * h3 heading * merge * updated the alert on basis if total pages * deleted chunks * polling based on total pages * isNan check * large file based on file size for s3 and gcs * file source in server side event * time calculation based on chunks for gcs and s3 --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> Co-authored-by: Prakriti Solankey <156313631+prakriti-solankey@users.noreply.github.com> Co-authored-by: abhishekkumar-27 <164544129+abhishekkumar-27@users.noreply.github.com> Co-authored-by: aashipandya <156318202+aashipandya@users.noreply.github.com> * fixed the layout issue * Populate graph schema (#399) * crreate new endpoint populate_graph_schema and update the query for getting lables from DB * Added main.py changes * conditionally-including-the-gcs-login-flow-in-gcs-as-source (#396) * added the condtion * removed llms * Fixed issue : Remove extra unused param * get emb only if used (#278) * Chatbot chunks (#402) * Added file name to the content sent to LLM * added chunk text in the response * increased the docs parts sent to llm * Modified graph query * mardown rendering * youtube starttime * icons * offset changes * removed the files due to codespace space issue --------- Co-authored-by: vasanthasaikalluri <165021735+vasanthasaikalluri@users.noreply.github.com> Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Settings modal to support generating the labels from the llm by using text given by user (#405) * added the json * added schema from text dialog * integrated the schemaAPI * added the alert * resize fixes * fixed css issue * fixed status blank issue * Modified response when no docs is retrived (#413) * Fixed env/docker-compose for local deployments + README doc (#410) * Fixed env/docker-compose for local deployments + README doc * wrong place for ENV in README * by default, removed langsmith + fixed knn score string to float * by default, removed langsmith + fixed knn score string to float * Fixed strings in docker-compose env * Added requirements (neo4j 5.15 or later, APOC, and instructions for Neo4j Desktop) * Missed the TIME_PER_PAGE env, was causing NaN issue in the approx time processing notification. fixed that * Support for all unstructured files (#401) * all unstructured files * responsiveness * added file type * added the extensions * spell mistake * ppt file changes --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Settings modal to support generating the labels from the llm by using text given by user with checkbox (#415) * added the json * added schema from text dialog * integrated the schemaAPI * added the alert * resize fixes * Extract schema using direct ChatOpenAI API and Chain * integrated the checkbox for schema to text dialog * Update SettingModal.tsx --------- Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * gcs file content read via storage client (#417) * gcs file content read via storage client * added the access token the file state --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * pypdf2 to read files from gcs (#420) * 407 remove driver from frontend (#416) * removed driver * removed API * connecting to database on page refresh --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Css handling of info modal and Tooltips (#418) * css change * toolTips * Sidebar Tooltips * copy to clip * css change * added image types * added gcs * type fix * docker changes * speech * added the toolip for dropzone sources --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Fixed retrival bugs (#421) * yarn format fixes * changed the delete message * added the cancel button * changed the message on tooltip * added space * UI fixes * tooltip for setting * updated req * wikipedia URL input (#424) * accept only wikipedia links * added wikipedia link * added wikilink regex * wikipedia single url only * changed the alert message * wording change * pushed validation state persist error --------- Co-authored-by: aashipandya <156318202+aashipandya@users.noreply.github.com> * speech and copy (#422) * speech and copy * startTime * added chunk properties * tooltips --------- Co-authored-by: vasanthasaikalluri <165021735+vasanthasaikalluri@users.noreply.github.com> Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Fixed issue for out of range in KNN API * solved conflicts * conflict solved * Remove logging info from update KNN API * tooltip changes * format and lint fixes * responsiveness changes * Fixed issue for total pages GCS, S3 * UI polishing (#428) * button and tooltip changes * checking validation on change * settings module populate fix * format fixes * opening the modal after auth success * removed the limit * added the scrobar for dropdowns * speech state (#426) * speech state * Button Details changes * delete wording change * Total pages in buckets (#431) * page number NA for buckets * added N/A for gcs and s3 pages * total pages for gcs * remove unwanted logger --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * removed the max width * Update FileTable.tsx * Update the docker file * Modified prompt (#438) * Update Dockerfile * Update Dockerfile * Update Dockerfile * rendering Fix * Local file upload gcs (#442) * Uplaod file to GCS * GCS local upload fixed issue and delete file from GCS after processing and failed or cancelled * Add life cycle rule on uploaded bucket * pdf upload local and gcs bucket check * delete files when processed and extract changes --------- Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * Modified chat length and entities used (#443) * metadata for unstructured files (#446) * Unstructured file metadata (#447) * metadata for unstructured files * sleep in gcs upload * updated * icons added to chunks (#435) * icons added to chunks * info modal icons * Dev (#433) * Integration_qa test (#375) * Test IntegrationQA added * update test cases * update test * update node count assertions * test changes * update changes * modification test * Code refatctor test cases * Handle allowedlist issue in test * test changes * update test * test case execution * test chatbot updates * test case update file * added file --------- Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * recent merges * pdf deletion due to out of diskspace * fixed status blank issue * Rendering the file name instead of link for gcs and s3 sources in the info modal * Convert is_cancelled value from string to bool * added the default page size * Issue fixed Processed chunked as 0 when file re-process again * Youtube timestamps (#386) * Wikipedia source to accept all valid urls * wikipedia url to support multiple languages * integrated wiki langauge param for extract api * Youtube video timestamps --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * groq llm integration backend (#286) * groq llm integration backend * groq and description in node properties * added groq in options --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * offset in chunks (#389) * page number in gcs loader (#393) * added youtube timestamps (#392) * chat pop up button (#387) * expand * minimize-icon * css changes * chat history * chatbot wider Side Nav * expand icon * chatbot UI * Delete * merge fixes * code suggestions --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * chunks create before extraction using is_pre_process variable (#383) * chunks create before extraction using is_pre_process variable * Return total pages for Model * update requirement.txt * total pages on uplaod API * added the Confirmation Dialog * added the selected files into the confirmation modal * format and lint fixes * added the stop watch image * fileselection on alert dialog * Add timeout in docker for gunicorn workers * Add cancel icon to info popup (#384) * Info Modal Changes * css changes * recent merges * Integration_qa test (#375) * Test IntegrationQA added * update test cases * update test * update node count assertions * test changes * update changes * modification test * Code refatctor test cases * Handle allowedlist issue in test * test changes * update test * test case execution * test chatbot updates * test case update file * added file --------- Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * fixed status blank issue * Rendering the file name instead of link for gcs and s3 sources in the info modal * added the default page size * Convert is_cancelled value from string to bool * Issue fixed Processed chunked as 0 when file re-process again * Youtube timestamps (#386) * Wikipedia source to accept all valid urls * wikipedia url to support multiple languages * integrated wiki langauge param for extract api * Youtube video timestamps --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * groq llm integration backend (#286) * groq llm integration backend * groq and description in node properties * added groq in options --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Save Total Pages in DB * Added total Pages * file selection when we didn't select anything from Main table * added the danger icon only for large files * added the overflow for more files and file selection for all new files * moved the interface to types * added the icon accoroding to the source * set total page for wiki and youtube * h3 heading * merge * updated the alert on basis if total pages * deleted chunks * polling based on total pages * isNan check * large file based on file size for s3 and gcs * file source in server side event * time calculation based on chunks for gcs and s3 --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> Co-authored-by: Prakriti Solankey <156313631+prakriti-solankey@users.noreply.github.com> Co-authored-by: abhishekkumar-27 <164544129+abhishekkumar-27@users.noreply.github.com> Co-authored-by: aashipandya <156318202+aashipandya@users.noreply.github.com> * fixed the layout issue * Populate graph schema (#399) * crreate new endpoint populate_graph_schema and update the query for getting lables from DB * Added main.py changes * conditionally-including-the-gcs-login-flow-in-gcs-as-source (#396) * added the condtion * removed llms * Fixed issue : Remove extra unused param * get emb only if used (#278) * Chatbot chunks (#402) * Added file name to the content sent to LLM * added chunk text in the response * increased the docs parts sent to llm * Modified graph query * mardown rendering * youtube starttime * icons * offset changes * removed the files due to codespace space issue --------- Co-authored-by: vasanthasaikalluri <165021735+vasanthasaikalluri@users.noreply.github.com> Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Settings modal to support generating the labels from the llm by using text given by user (#405) * added the json * added schema from text dialog * integrated the schemaAPI * added the alert * resize fixes * fixed css issue * fixed status blank issue * Modified response when no docs is retrived (#413) * Fixed env/docker-compose for local deployments + README doc (#410) * Fixed env/docker-compose for local deployments + README doc * wrong place for ENV in README * by default, removed langsmith + fixed knn score string to float * by default, removed langsmith + fixed knn score string to float * Fixed strings in docker-compose env * Added requirements (neo4j 5.15 or later, APOC, and instructions for Neo4j Desktop) * Missed the TIME_PER_PAGE env, was causing NaN issue in the approx time processing notification. fixed that * Support for all unstructured files (#401) * all unstructured files * responsiveness * added file type * added the extensions * spell mistake * ppt file changes --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Settings modal to support generating the labels from the llm by using text given by user with checkbox (#415) * added the json * added schema from text dialog * integrated the schemaAPI * added the alert * resize fixes * Extract schema using direct ChatOpenAI API and Chain * integrated the checkbox for schema to text dialog * Update SettingModal.tsx --------- Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * gcs file content read via storage client (#417) * gcs file content read via storage client * added the access token the file state --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * pypdf2 to read files from gcs (#420) * 407 remove driver from frontend (#416) * removed driver * removed API * connecting to database on page refresh --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Css handling of info modal and Tooltips (#418) * css change * toolTips * Sidebar Tooltips * copy to clip * css change * added image types * added gcs * type fix * docker changes * speech * added the toolip for dropzone sources --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Fixed retrival bugs (#421) * yarn format fixes * changed the delete message * added the cancel button * changed the message on tooltip * added space * UI fixes * tooltip for setting * updated req * wikipedia URL input (#424) * accept only wikipedia links * added wikipedia link * added wikilink regex * wikipedia single url only * changed the alert message * wording change * pushed validation state persist error --------- Co-authored-by: aashipandya <156318202+aashipandya@users.noreply.github.com> * speech and copy (#422) * speech and copy * startTime * added chunk properties * tooltips --------- Co-authored-by: vasanthasaikalluri <165021735+vasanthasaikalluri@users.noreply.github.com> Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * Fixed issue for out of range in KNN API * solved conflicts * conflict solved * Remove logging info from update KNN API * tooltip changes * format and lint fixes * responsiveness changes * Fixed issue for total pages GCS, S3 * UI polishing (#428) * button and tooltip changes * checking validation on change * settings module populate fix * format fixes * opening the modal after auth success * removed the limit * added the scrobar for dropdowns * speech state (#426) * speech state * Button Details changes * delete wording change * Total pages in buckets (#431) * page number NA for buckets * added N/A for gcs and s3 pages * total pages for gcs * remove unwanted logger --------- Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> * removed the max width * Update FileTable.tsx * Update the docker file * Modified prompt (#438) * Update Dockerfile * Update Dockerfile * Update Dockerfile * rendering Fix * Local file upload gcs (#442) * Uplaod file to GCS * GCS local upload fixed issue and delete file from GCS after processing and failed or cancelled * Add life cycle rule on uploaded bucket * pdf upload local and gcs bucket check * delete files when processed and extract changes --------- Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> * Modified chat length and entities used (#443) * metadata for unstructured files (#446) * Unstructured file metadata (#447) * metadata for unstructured files * sleep in gcs upload * updated * icons added to chunks (#435) * icons added to chunks * info modal icons --------- Co-authored-by: abhishekkumar-27 <164544129+abhishekkumar-27@users.noreply.github.com> Co-authored-by: Pravesh Kumar <121786590+praveshkumar1988@users.noreply.github.com> Co-authored-by: kartikpersistent <101251502+kartikpersistent@users.noreply.github.com> Co-authored-by: vasanthasaikalluri <165021735+vasanthasaikalluri@users.noreply.github.com> Co-authored-by: Prakriti Solankey <156313631+prakriti-solankey@users.noreply.github.com> Co-authored-by: Ajay Meena <meenajy1996@gmail.com> Co-authored-by: Morgan Senechal <morgan@neo4j.com> Co-authored-by: karanchellani <142801957+karanchellani@users.noreply.github.com> * fixed gcs status message issue * added if check for failed count * Null issue Fixed from backend for upload API and graph_document when model name mismatch * added word break issue * Added neo4j-rust-ext * proc…
1 parent 65b4639 commit e404f4f

9 files changed

Lines changed: 207 additions & 41 deletions

File tree

README.md

Lines changed: 8 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -114,7 +114,7 @@ Run the application using the default `docker-compose` configuration.
114114
By default, only OpenAI and Diffbot are enabled. Gemini requires additional GCP configurations.
115115
Use the `VITE_LLM_MODELS_PROD` variable to configure the models you need. Example:
116116
```bash
117-
VITE_LLM_MODELS_PROD="openai_gpt_5_mini,diffbot,gemini_2.5_flash"
117+
VITE_LLM_MODELS_PROD="gemini_2.5_flash,openai_gpt_5_mini,diffbot,anthropic_claude_4.5_haiku"
118118
```
119119

120120
2. **Input Sources:**
@@ -235,8 +235,6 @@ gcloud run deploy dev-backend \
235235

236236
---
237237

238-
## [ENV][env-sheet]
239-
240238
## [ENV][env-sheet]
241239
| Env Variable Name | Mandatory/Optional | Default Value | Description |
242240
|------------------------ |-------------------|---------------|--------------------------------------------------------------------------------------------------|
@@ -251,7 +249,7 @@ gcloud run deploy dev-backend \
251249
| DUPLICATE_TEXT_DISTANCE | Optional | 5 | This value is used to find distance for all node pairs in the graph and is calculated based on node properties |
252250
| DUPLICATE_SCORE_VALUE | Optional | 0.97 | Node score value to match duplicate nodes |
253251
| EFFECTIVE_SEARCH_RATIO | Optional | 1 | Ratio used for effective search calculations |
254-
| GRAPH_CLEANUP_MODEL | Optional | openai_gpt_4o_mini | Model name to clean up graph in post processing |
252+
| GRAPH_CLEANUP_MODEL | Optional | openai_gpt_5_mini | Model name to clean up graph in post processing |
255253
| MAX_TOKEN_CHUNK_SIZE | Optional | 10000 | Maximum token size to process file content |
256254
| YOUTUBE_TRANSCRIPT_PROXY| Mandatory | | Proxy key to process YouTube videos for getting transcripts |
257255
| IS_EMBEDDING | Optional | true | Flag to enable text embedding |
@@ -282,7 +280,12 @@ gcloud run deploy dev-backend \
282280
| VITE_TOKENS_PER_CHUNK | Optional | 100 | Variable to configure tokens count per chunk. This gives flexibility for users who may require different chunk sizes for various tokenization tasks |
283281
| VITE_CHUNK_TO_COMBINE | Optional | 1 | Variable to configure number of chunks to combine for parallel processing |
284282

285-
### Refer to this link for additional [Environment Variables][env-vars].
283+
### Example Environment Files
284+
285+
Refer to the example environment files for additional variables and configuration:
286+
287+
- [Backend example.env](https://github.com/neo4j-labs/llm-graph-builder/blob/main/backend/example.env)
288+
- [Frontend example.env](https://github.com/neo4j-labs/llm-graph-builder/blob/main/frontend/example.env)
286289

287290
---
288291

backend/src/main.py

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -515,11 +515,7 @@ async def processing_source(credentials, params, pages, merged_file_path=None, i
515515
logging.info(obj_source_node)
516516
#pre checking if user is allowed to process the file
517517
if get_value_from_env("TRACK_USER_USAGE", "false", "bool"):
518-
try:
519-
track_token_usage(credentials.email, credentials.uri, 0, params.model, operation_type="precheck")
520-
except LLMGraphBuilderException as e:
521-
logging.error(str(e))
522-
raise RuntimeError(str(e))
518+
track_token_usage(credentials.email, credentials.uri, 0, params.model, operation_type="precheck")
523519
start_update_source_node = time.time()
524520
graphDb_data_Access.update_source_node(obj_source_node)
525521
graphDb_data_Access.update_node_relationship_count(params.file_name)

backend/src/shared/constants.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -247,8 +247,8 @@
247247
CHAT_EMBEDDING_FILTER_SCORE_THRESHOLD = 0.10
248248

249249
CHAT_TOKEN_CUT_OFF = {
250-
('openai_gpt_3.5','azure_ai_gpt_35',"gemini_1.0_pro","gemini_1.5_pro", "gemini_1.5_flash","groq-llama3",'groq_llama3_70b','anthropic_claude_3_5_sonnet','fireworks_llama_v3_70b','bedrock_claude_3_5_sonnet', ) : 4,
251-
("openai-gpt-4","diffbot" ,'azure_ai_gpt_4o',"openai_gpt_4o", "openai_gpt_4o_mini") : 28,
250+
("gemini_2.5_pro", "gemini_2.5_flash","groq-llama3",'groq_llama3_70b','anthropic_claude_4_5_sonnet','anthropic_claude_4') : 4,
251+
("openai_gpt_5.2","diffbot","openai_gpt_5_mini") : 28,
252252
("ollama_llama3") : 2
253253
}
254254

docs/backend/backend_docs.adoc

Lines changed: 94 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,64 @@ Based on the response from this API, the frontend UI displays the connection sta
3636
}
3737
----
3838

39+
=== Get Token Limits
40+
----
41+
POST /get_token_limits
42+
----
43+
44+
Fetches the token usage limits/quota for the configured LLM provider (OpenAI, Gemini, Anthropic, etc.) for the logged‑in user.
45+
46+
**API Parameters :**
47+
* `uri` = Neo4j URI
48+
* `userName` = Neo4j database username
49+
* `password` = Neo4j database password
50+
* `database` = Neo4j database name
51+
* `email` = Logged in User Email
52+
53+
**Response :**
54+
[source,json,indent=0]
55+
----
56+
{
57+
"status": "Success",
58+
"data": {
59+
"daily_remaining": 250000,
60+
"monthly_remaining": 815234,
61+
"daily_limit": 250000,
62+
"monthly_limit": 1000000,
63+
"daily_used": 0,
64+
"monthly_used": 184766
65+
},
66+
"message": "Token limits fetched successfully"
67+
}
68+
----
69+
70+
=== Fetch Embedding Models
71+
----
72+
POST /fetch_embedding_model
73+
----
74+
75+
This API returns the currently selected embedding provider, embedding model, embedding dimension, and whether the vector index needs to be recreated.
76+
77+
**API Parameters :**
78+
* `uri` = Neo4j URI
79+
* `userName` = Neo4j database username
80+
* `password` = Neo4j database password
81+
* `database` = Neo4j database name
82+
* `email` = Logged in User Email
83+
84+
**Response :**
85+
[source,json,indent=0]
86+
----
87+
{
88+
"status": "Success",
89+
"data": [
90+
"openai",
91+
"text-embedding-3-small",
92+
1536,
93+
true
94+
]
95+
}
96+
----
3997

4098
=== Upload Files from Local
4199
----
@@ -441,8 +499,8 @@ The API responsible for a chatbot system designed to leverage multiple AI models
441499

442500
**Components :**
443501

444-
** Embedding Models - Includes OpenAI Embeddings, VertexAI Embeddings, and SentenceTransformer Embeddings(Default) to support vector-based query operations.
445-
** AI Models - OpenAI GPT 3.5, GPT 4o, GPT 40 mini, gemini_1.5_flash can be configured for the chatbot backend to generate responses and process natural language.
502+
** Embedding Models - Includes OpenAI Embeddings, VertexAI Embeddings, BedrockEmbeddings and SentenceTransformer Embeddings(Default) to support vector-based query operations.
503+
** AI Models - OpenAI GPT 5 mini, gemini_2.5_flash, anthropic claude 4.5 haiku can be configured for the chatbot backend to generate responses and process natural language.
446504
** Graph Database (Neo4jGraph) - Manages interactions with the Neo4j database, retrieving, and storing conversation histories.
447505
** Response Generation - Utilizes Vector Embeddings from the Neo4j database, chat history, and the knowledge base of the LLM used.
448506
** Chat Modes - Vector , Graph, Vector + Graph, Fulltext, Vector + Graph+Fulltext, Entity Search + Vector, Global search Vector
@@ -1140,6 +1198,40 @@ The API is used to merge duplicate entities from database selected by user.
11401198
"message": "Duplicate entities merged successfully"
11411199
}
11421200
....
1201+
1202+
=== Change Embedding Model
1203+
----
1204+
POST /change_embedding_model
1205+
----
1206+
1207+
This API updates the active embedding provider and embedding model for the backend.
1208+
If the selected model has a different embedding dimension from the existing vector index,
1209+
the backend automatically drops and recreates the vector index.
1210+
1211+
**API Parameters :**
1212+
* `uri` = Neo4j URI
1213+
* `userName` = Neo4j database username
1214+
* `password` = Neo4j database password
1215+
* `database` = Neo4j database name
1216+
* `embedding_provider` = Selected embedding provider (openai, gemini, vertexai, bedrock, sentence_transformer)
1217+
* `embedding_model` = Embedding model chosen by the user
1218+
* `email` = Logged in User Email
1219+
1220+
**Response :**
1221+
[source,json,indent=0]
1222+
----
1223+
{
1224+
"status": "Success",
1225+
"data": {
1226+
"embedding_provider": "gemini",
1227+
"embedding_model": "gemini-embedding-001",
1228+
"embedding_dimension": 3072,
1229+
"change_index": true
1230+
},
1231+
"message": "Embedding model changed successfully. Vector index was dropped and recreated."
1232+
}
1233+
----
1234+
11431235
=== Drop and create vector index
11441236
----
11451237
POST /drop_create_vector_index

0 commit comments

Comments
 (0)