6 commits

Author	SHA1	Message	Date
lin onetwo	256e0fcb65	Chore/upgrade2 (#656) ... * upgrade rjsf * Always enable devTools, even in test mode for debugging * Update index.tsx * lint * fix: properly log error to log file * fix: precalculate json plugin route and exclude it even before save * Update WatchFileSystemAdaptor.ts * fix: hooks.addHook usage wrong * fix: tw5-typed * fix: outdated rjsf usage * refactor: cleanup fs watch logs * v0.13.0-rc5 * fix: lint * fix: unused * fix: IFileInfo type * fix: type * fix: failed rjsf test	2025-11-23 12:31:02 +08:00
lin onetwo	ed198d375b	Feat/git chart (#651) ... * feat: basic git gui using @tomplum/react-git-log * Replace menu bar toggle with mini window shortcut Removed the menu bar toggle option and its Windows-specific logic from the View menu. Added a new menu item for toggling the Tidgi mini window, using a configurable keyboard shortcut from preferences. * update i18n * refactor: use table for default view for cleaner timeline * test: commit * Add realtime git log updates and e2e test support Implements detection and display of uncommitted changes in the Git Log window, adds a commit button for uncommitted changes, and refreshes data in response to git state changes using an observable. Adds e2e test step definitions and log markers for commit, revert, and checkout operations to support automated testing. Removes alert popups from commit, revert, and checkout actions in the UI. * refactor: steps with descripton * fix: watch fs on git checkout * fix: echo of file on start * feat: loading state on revert * feat: ai commit message * feat: check free model * fix: remove duplicated backup action * fix: git method wrong place * fix: model not auto filled * refactor: preload $:/info/tidgi/workspaceID by 'module-type': 'info', * fix: workspace context menu * fix: show correct menu on view * feat: let tooltip show files instead of hash * feat: view dark theme * feat: better diff ui, and upgrade dugite * Update aiCommitMessage.ts * Update gitLog.feature * fix: menu click test * fix: The isInitialLoad check is computed twice * fix: import wiki form cursor position wrong * fix: git log frequently load data * fix: hide wiki menu * fix: import wiki form not working * fix: timer not cleared * onBlur handler that resets the field to the current valid preference value * fix: review error * Update useGitLogData.ts * Update newAgent.feature * Update newAgent.feature * fix: test randomly fail * fix * fix * Update wiki.ts * fix: wait for mark * Git-Sync-JS logger fix * Git-Sync-JS more logs * Git-sync-js fix no commiter email * Update gitOperations.ts	2025-11-08 15:04:34 +08:00
lin onetwo	9a6f3480f5	Feat/watch fs (#649) ... * Add watch-filesystem-adaptor plugin and worker IPC Introduces the watch-filesystem-adaptor TiddlyWiki plugin, enabling tag-based routing of tiddlers to sub-wikis by querying workspace info via worker thread IPC. Adds workerServiceCaller utility for worker-to-main service calls, updates workerAdapter and bindServiceAndProxy to support explicit service registration for workers, and documents the new IPC architecture. Updates wikiWorker and startNodeJSWiki to preload workspace ID and load the new plugin. Also updates the plugin build script to compile and copy the new plugin. * test: wiki operation steps * Add per-wiki labeled logging and console hijack Introduces labeled loggers for each wiki, writing logs to separate files. Adds a logFor method to NativeService for logging with labels, updates interfaces, and hijacks worker thread console methods to redirect logs to main process for wiki-specific logging. Refactors workspaceID usage to workspace object for improved context. * Update log handling for wiki worker and tests Enhanced logging tests to check all log files, including wiki logs. Adjusted logger to write wiki worker logs to the main log directory. Updated e2e app script comment for correct usage. * Enable worker thread access to main process services Introduces a proxy system allowing worker threads to call main process services with full type safety and observable support. Adds worker-side service proxy creation, auto-attaches proxies to global.service, and updates service registration to use IPC descriptors. Documentation is added for usage and architecture. * Update ErrorDuringStart.md * chore: upgrade ipc cat and allow clean vite cache * Refactor wiki worker initialization and service readiness Moved wiki worker implementation from wikiWorker.ts to wikiWorker/index.ts and deleted the old file. Added servicesReady.ts to manage worker service readiness and callbacks, and integrated notifyServicesReady into the worker lifecycle. Updated console hijack logic to wait for service readiness before hijacking. Improved worker management in Wiki service to support detaching workers and notifying readiness. * Refactor wiki logging to use centralized logger Removed per-wiki loggers and console hijacking in favor of a single labeled logger. All wiki logs, including errors, are now written to a unified log file. Updated worker and service code to route logs through the main logger and removed obsolete log file naming and management logic. * fix: ipc cat log error * Refactor wiki test paths and improve file save logic Updated test step to use wikiTestRootPath for directory replacements and added wikiTestRootPath to paths.ts for clarity. Improved error handling and directory logic in watch-filesystem-adaptor.ts, including saving tiddlers directly to sub-wiki folders, more informative logging, and ensuring cleanup after file writes is properly awaited. * rename * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * feat: basic watch-fs * feat: check file not exist * refactor: use exponential-backoff * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * Initial commit when init a new git. * fix: cleanup * Refactor test setup and cleanup to separate file Moved Before and After hooks from application.ts to a new cleanup.ts file for better organization and separation of concerns. Also removed unused imports and related code from application.ts. Minor type simplification in agent.ts for row parsing. * test: modify and rename * feat: enableFileSystemWatch * refactor: unused utils.ts * Update watch-filesystem-adaptor.ts * refactor: use node-sentinel-file-watcher * refactor: extract to two classes * The logFor method lacks JSDoc describing the level parameter's * Update startNodeJSWiki.ts * fix: napi build * Update electron-rebuild command in workflows Changed the electron-rebuild command in release and test GitHub Actions workflows to use a comma-separated list for native modules instead of multiple -w flags. This simplifies the rebuild step for better-sqlite3 and nsfw modules. * lint * not build nsfw, try use prebuild * Update package.json * Update workerAdapter.ts * remove subWikiPlugin.ts as we use new filesystem adaptor that supports tag based sub wiki * fix: build * fix: wrong type * lint * remove `act(...)` warnings * uninstall chokidar * refactor and test * lint * remove unused logic, as we already use ipc syncadaptor, not afriad of wiki status change * Update translation.json * test: increast timeout in CI * Update application.ts * fix: AI's wrong cleanup logic hidden by as unknown as * fix: AI's wrong as unknown as * Update agent.feature * Update wikiSearchPlugin.ts * fix: A dynamic import callback was not specified.	2025-10-28 13:25:46 +08:00
lin onetwo	b76fc17794	Chore/upgrade (#646) ... * docs: deps * Update dependencies and type usage for AI features Upgraded multiple dependencies in package.json and pnpm-lock.yaml, including @ai-sdk, @mui, react, and others for improved compatibility and performance. Changed type usage from CoreMessage to ModelMessage in mockOpenAI.test.ts to align with updated ai package. No functional changes to application logic. * feat: i18n * feat: test oauth login and use PKCE * fix: use ollama-ai-provider-v2 * test: github and mock oauth2 login * test: gitea login * Refactor context menu cleanup and error message Moved context menu cleanup for OAuth window to a single closed event handler in Authentication service. Simplified error message formatting in ContextService for missing keys. * lint: AI fix * Add tsx as a dev dependency and update scripts Replaced usage of 'pnpm dlx tsx' with direct 'tsx' command in development and test scripts for improved reliability. Added 'tsx' to devDependencies in package.json.	2025-10-23 23:42:06 +08:00
lin onetwo	19ef74a4a6	Feat/mini window (#642) ... * feat: new config for tidgi mini window * chore: upgrade electron-forge * fix: use 汉语 和 漢語 * feat: shortcut to open mini window * test: TidGiMenubarWindow * feat: allow updateWindowProperties on the fly * fix: wrong icon path * fix: log not showing error message and stack * refactor: directly log error when using logger.error * feat: shortcut to open window * fix: menubar not closed * test: e2e for menubar * test: keyboard shortcut * test: wiki web content, and refactor to files * test: update command * Update Testing.md * test: menubar settings about menubarSyncWorkspaceWithMainWindow, menubarFixedWorkspaceId * test: simplify menubar test and cleanup test config * fix: view missing when execute several test all together * refactor: use hook to cleanup menubar setting * refactor: I clear test ai settings to before hook * Add option to show title bar on menubar window Introduces a new preference 'showMenubarWindowTitleBar' allowing users to toggle the title bar visibility on the menubar window. Updates related services, interfaces, and UI components to support this feature, and adds corresponding localization strings for English and Chinese. * refactor: tidgiminiwindow * refactor: preference keys to right order * Refactor window dimension checks to use constants Replaces hardcoded window dimensions with values from windowDimension and WindowNames constants for improved maintainability and consistency in window identification and checks. * I cleanup test wiki * Update defaultPreferences.ts * test: mini window workspace switch * fix: image broken by ai, and lint * fix: can't switch to mini window * refactor: useless todo * Update index.ts * refactor: reuse serialize-error * Update index.ts * Update testKeyboardShortcuts.ts * refactor: dup logic * Update ui.ts * fix: electron-ipc-cat	2025-10-21 20:07:04 +08:00
lin onetwo	fa9751e5ea	Feat/Native AI Agent (#640) ... * refactor: only use message id * feat: stream update, but react don't react on it dny * feat: start stop * feat: basic resoponse handlers * feat: load handler config schema * chore: upgrade to "moduleResolution": "bundler" * fix: prompt concat * feat: rjfs with mui * fix: mui v7 upgrade * fix: field editor tabs * feat: Description field is i18n key, use i18nAlly extension to see it on VSCode. And use react-i18next to translate it on frontend. * refactor: extract some shared components * refactor: remove @mui/lab * feat: faster editor * feat: beautify editor * refactor: better style * fix: fullscreen style * fix: array sort * fix: editor not saved * fix: broken array * chore: upgrade mui deps * Update type.d.ts * feat: upgrade and install react dev tools * refactor: simplify the code * refactor: simplify the code * refactor: simplify ai generated garbage code * fix: translated label * feat: translate enum and conditional show field based on enum * feat: click to open source * fix: ai generated garbage code to solve id and index problem * refactor: simplify * refactor: shorten * test: add jest * chore: node-linker=hoisted as electron forge suggested * test: e2e * fix: test failed on ci * test: faster by disable some typecheck * fix: ci * fix: ci * refactor: remove unused * fix: use macos and take screenshot in ci * docs: (cherry picked from commit b1a9706264) * fix: ci crash due to no dugite binary, due to NODE_ENV=test not set * Update test.yml * fix: ci * Update release.yml * docs: test * refactor: move folders and lint * refactor: organize pages to reduce level * refactor: merge page service and workspace service to allow drag & drop of pages * Update ipc-syncadaptor.ts * Update browserViewMetaData.ts * fix: view.webContents.loadURL won't reload on new electron version * fix: try to disable annoying useless disabling pasting "feature" https://github.com/electron/electron/issues/40995 * fix: initial page * feat: allow sort add icon * test: use vitest instead * refactor: use emotion instead * fix: all ts error after migrate to vitest and emotion * fix: Component selectors can only be used in conjunction with @emotion/babel-plugin, the swc Emotion plugin, or another Emotion-aware compiler transform. fix by not using this usage * fix: too many open files * test: add basic main page test * refactor: split workspace type to make it more specific * test: support mock react lazy import component by re-export them * test: sidebar * refactor: move mock to global * test: testing library fix * test: new wiki form * docs: test with vitest * lint: fix * docs: pronounication & remove toc as gh build in * feat: tools and rag * feat: prompt for build-in tools * fix: i18n * fix: tool using * test: fix * refactor: Auto-create default wiki workspace if none exists (handled in backend) * fix: create wiki workspace so it is on first one * refactor: remove some useless feature * refactor: use plugin instead of handler * chore: make concatPrompt async iterator * feat: show progress on frontend * fix: errors * fix: ConfigError: Config (unnamed): Key "overrides": This appears to be in eslintrc format rather than flat config format. * Update package.json * feat: allow windows to hide titlebar * fix: logger error when ctrl+c on mac * lint * refactor: use plugin everywhere * refactor: move more logic to plugin * refactor: run tool in plugin, simplify abstraction * refactor: remove ai generated duplicate * refactor * refactor: less plugins * test: simplify wiki search test * test: remove any * fix: not streaming, tool order wrong * test: plugin system and streaming * refactor: remove useless auto reply plugin * fix: hide duration expired tool calling message, so long tool result only show to ai once * fix: $ props should lower cased * test: support run as electron so can use sqlite3 compiled bin for electron * docs: better electron as node run and doc * test: restore to use threads instead of fock. Seems this also works for inmemory database * test: fix frontend ui test * lint: ai content * test: fix coverage * test: Refactor test mocks to dedicated __mocks__ directory Moved common test mocks from setup-vitest.ts into separate files under src/__tests__/__mocks__ for better organization and maintainability. Updated documentation to reflect the new structure. Removed fileMock.js and updated setup-vitest.ts to import and use the new centralized mocks. * Update ErrorDuringStart.md * Update messageManagementPlugin.test.ts * test: Fix Electron test process cleanup and update test config Update test:unit script to use cross-env for ELECTRON_RUN_AS_NODE, ensuring child processes inherit the variable and preventing resource leaks. Remove manual process.env setting from vitest.config.ts and add documentation on handling related errors in Testing.md. Also, add 'hanging-process' reporter to Vitest config for improved diagnostics. * fix: warning in test * Create AgentInstanceWorkflow.md * fix: duration bug * fix: ai not response for tool result * test: Add agent workflow feature and step definitions Introduces a new Cucumber feature for agent workflow, including multi-round conversation and tool usage. Adds agent-specific step definitions for message input and chat history validation. Refactors application step definitions for improved selector handling and element interaction. Updates test scripts in package.json to include a preparation step for e2e tests. * Update application.ts * test: Add mock OpenAI server and tests Introduces a MockOpenAIServer for simulating OpenAI chat completions, including tool call and tool result responses. Adds corresponding tests and updates vitest config to include tests in the features directory. * test: simplify steps * test: Add separate test userData and wiki folders Introduces 'userData-test' and 'wiki-test' folders for test environments, updating appPaths, fileNames, and paths constants to distinguish between development and test modes. This helps prevent conflicts when running test and development instances simultaneously. * Update eslint.config.mjs @typescript-eslint/no-unnecessary-condition': 'off' * test: Add data-testid attributes for test automation Added data-testid attributes to form inputs and buttons in ExternalAPI components to improve test automation reliability. Updated feature files and step definitions to use these selectors, refined window switching logic, and improved timing for UI interactions. Also exposed isElectronDevelopment and added isMainWindowPage utility for window identification. * test: fix wront page type by ai written garbage code * Update application.ts * Update Testing.md * fix: no log during e2e test, and error creating wiki blocks other init steps * test: click agent workspace button, and refactor mock server * test: mock streamable openai api * rename * chore: try esbuild loader, renderer build too slow * chore: organize webpack * chore: ignore service code from hot reload * Update Testing.md * test: use full agentinstance in test * chore: webpack error * Update Testing.md * chore: remove useless spectron * test: EsbuildPlugin's `define` doesn't work, it won't set env properly. * test: e2e mock openai * lint: disable @typescript-eslint/require-await * test: Add quick access to create default agent tab Introduces a 'Create Default Agent' quick access button in the Agent New Tab page, with localization support. Adds utility to close all tabs and create a default agent tab for fallback scenarios, improves test selectors for tab and close actions, and refactors agent chat tab creation logic for consistency and testability. * feat: remove unuse favorite * feat: Add wiki operation and workspaces list plugins Introduces wikiOperationPlugin and workspacesListPlugin for agent instance prompt and response handling. Updates plugin registry, test coverage, and default agent configuration to support wiki workspace listing and wiki note operations (create, update, delete) via tool calls. Refactors wikiSearchPlugin to delegate workspace list injection to workspacesListPlugin. * Refactor plugin schema system for dynamic registration Introduces a dynamic plugin schema registry, allowing plugins to register their parameter schemas and metadata at runtime. Refactors prompt concat schema generation to use dynamically registered plugin schemas, removes static plugin schema definitions, and updates all plugin files to export their parameter schemas. Adds new modelContextProtocolPlugin and schemaRegistry modules, and updates plugin initialization to register schemas and metadata. This enables extensibility and type safety for plugin configuration and validation. * refactor: move PromptConfigForm to inside PromptPreviewDialog * test: frontent render tool usage info * test: split file * test: fix error * test: wiki operation * test: remove log and clean up test deps * Update i18next-electron-fs-backend.ts * fix: wikiOperationInServer not called due to no message * test: fix * test: Refactor agent feature setup and improve mock server URL handling Moved AI provider and model configuration to a shared setup scenario in agent.feature to avoid redundant steps in each test. Enhanced application.ts to use a fallback localhost URL for MOCK_SERVER_URL when the mock server is not available, improving test reliability. * Remove retry logic from basicPromptConcatHandler Eliminated retryCount and maxRetries from basicPromptConcatHandler, simplifying the control flow and removing the retry limit for LLM calls. Logging and yield logic were updated to reflect the removal of retries. * Update agent.feature * test: agent and default wiki * test: refactor wiki cleanup * Update agent.feature * Refactor AI settings setup and add preference feature Moved AI provider and model configuration steps from agent.feature to a new preference.feature file for better separation of concerns. Updated step definitions in agent.ts to improve robustness when reading and writing settings files, including type usage and directory checks. * test: try debug can't stop bug * Update Testing.md * fix: cancel agent not update cancel button * refactor: update Frontend use `void window.service.native.log` to log to file. * test: log from renderer test * feat: add default embedding model config and victor search service and search preference panel * test: default embedding form and * test: default agent * refator: unused tool listing methods * Refactor test database setup for integration tests Centralizes in-memory SQLite test database initialization and cleanup in shared utilities for all integration tests. Updates agentDefinition and messageManagementPlugin tests to use the shared test database, improving reliability and reducing code duplication. * fix: app path wrong in unit test * feat: externalAPIDebug * test: embedding service and let db use real in memory one * test: provide at least one tab for close tab test * fix: victor db not loaded in new connection * test: disable hot reload * Update DeveloperTools.tsx * feat: tool message & wiki tool schema * feat: pref to open db * chore: skip ExternalsPlugin on dev * fix: APIs doesn't accept 'tool' role, and it won't return anything when API calls * fix: docs and remove ai fake fix * refactor: get agent list don't need to have message * Update basicPromptConcatHandler.failure.test.ts * Update basicPromptConcatHandler.test.ts * fix: role wrong cause e2e failed * test: allow e2e create .db file to check * feat: create new agent * feat: getAgentDefinitionTemplatesFromWikis * fix: Prevent update non-active (hiding) wiki workspace, so it won't pop up to cover other active agent workspace * fix: Ensure the config change is fully persisted before proceeding * test: Don't bring up window when running e2e test, otherwise it will annoy the developer who is doing other things. * feat: Edit existing agent definition workflow * Update StyledArrayContainer.tsx * test: prevent mock server hang * Refactor UI step definitions into separate file Moved UI-related Cucumber step definitions from application.ts to a new ui.ts file for better separation of concerns and maintainability. application.ts now only contains application-specific logic. * lint: ai auto fix * Clean up feature files and improve test coverage Removed unnecessary blank lines and improved formatting in feature files for better readability. Updated tsconfig to use 'bundler' module resolution. Enhanced EditAgentDefinitionContent test to mock and verify console.error output. Added type annotation for IAgentDefinitionService in basicPromptConcatHandler.failure.test.ts for improved type safety. * test: simplify message text match * feat: transcription and image generation model config * fix: style props error * chore: remove unused file * chore: try to imporove dev start speed but no sig improvment Replaces 'pnpm start' with 'pnpm start:init' for initial setup and documents slow startup in development. Adds a debug Webpack script, disables polling in renderer file watching, and only enables CircularDependencyPlugin in production/CI for faster dev builds. WebpackBar now only shows when DEBUG includes 'electron-forge:*'. ForkTsCheckerWebpackPlugin is now configured for async checks with memory limits and test file exclusion. Updates documentation to reflect these changes. * docs: why not vite * refactor: basic vite usage, but wiki worker is not running and view is not showing * refactor: remove lazy inject so vite works and wiki worker works, wiki in browser view can loads * Replace electron-squirrel-startup with inline implementation Added a custom Squirrel event handler in src/helpers/squirrelStartup.ts to handle Windows install/update/uninstall events, replacing the electron-squirrel-startup package. This avoids ESM/CommonJS compatibility issues and simplifies event handling in src/main.ts. * refactor: vite build and test * fix: e2e still use dev wiki folder * fix: provide env * chore: "tiddlywiki": "5.3.7" * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix: missing i18n * test: Module did not self-register: '/home/runner/work/TidGi-Desktop/TidGi-Desktop/node_modules/better-sqlite3/build/Release/better_sqlite3.node'. * feat: i18n * feat: zh-Hant i18n * Update test.yml * feat: zh-Hans in test * test: i18n * refactor: ts forge config * lint: fix * chore: update wiki * Update pnpm-lock.yaml * chore: update github action versions * Update wiki * fix: pnpm then node * fix: Multiple versions of pnpm specified * Update test.yml * fix: Failed to take screenshot: page.screenshot: Target page, context or browser has been closed * chore: CodeQL Action major versions v1 and v2 have been deprecated. * chore: parallel codeql * Update test.yml * fix: i18n test not passing * test: step screenshot in each folder * fix: can't unzip, may due to file path * test: increase timeout in CI * docs: more log about wiki creation, and add log to criticial path * Refactor: logging for structured and consistent output Replaces string-based logger messages with structured logging throughout the codebase, providing function names, error messages, and relevant context as objects. This improves log readability, enables better filtering and searching, and standardizes error and debug reporting across services. * chore: debug wiki copy * fix: wiki submodule not cloned * Revert "test: increase timeout in CI" This reverts commit eff8583a01. * test: reduce wait time, because most check already will wait for a while * test: batch some e2e steps to reduce screenshot count * Update index.ts * chore: remove webpack files, use vite plugins --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-10-10 17:16:56 +08:00