* Add watch-filesystem-adaptor plugin and worker IPC
Introduces the watch-filesystem-adaptor TiddlyWiki plugin, enabling tag-based routing of tiddlers to sub-wikis by querying workspace info via worker thread IPC. Adds workerServiceCaller utility for worker-to-main service calls, updates workerAdapter and bindServiceAndProxy to support explicit service registration for workers, and documents the new IPC architecture. Updates wikiWorker and startNodeJSWiki to preload workspace ID and load the new plugin. Also updates the plugin build script to compile and copy the new plugin.
* test: wiki operation steps
* Add per-wiki labeled logging and console hijack
Introduces labeled loggers for each wiki, writing logs to separate files. Adds a logFor method to NativeService for logging with labels, updates interfaces, and hijacks worker thread console methods to redirect logs to main process for wiki-specific logging. Refactors workspaceID usage to workspace object for improved context.
* Update log handling for wiki worker and tests
Enhanced logging tests to check all log files, including wiki logs. Adjusted logger to write wiki worker logs to the main log directory. Updated e2e app script comment for correct usage.
* Enable worker thread access to main process services
Introduces a proxy system allowing worker threads to call main process services with full type safety and observable support. Adds worker-side service proxy creation, auto-attaches proxies to global.service, and updates service registration to use IPC descriptors. Documentation is added for usage and architecture.
* Update ErrorDuringStart.md
* chore: upgrade ipc cat and allow clean vite cache
* Refactor wiki worker initialization and service readiness
Moved wiki worker implementation from wikiWorker.ts to wikiWorker/index.ts and deleted the old file. Added servicesReady.ts to manage worker service readiness and callbacks, and integrated notifyServicesReady into the worker lifecycle. Updated console hijack logic to wait for service readiness before hijacking. Improved worker management in Wiki service to support detaching workers and notifying readiness.
* Refactor wiki logging to use centralized logger
Removed per-wiki loggers and console hijacking in favor of a single labeled logger. All wiki logs, including errors, are now written to a unified log file. Updated worker and service code to route logs through the main logger and removed obsolete log file naming and management logic.
* fix: ipc cat log error
* Refactor wiki test paths and improve file save logic
Updated test step to use wikiTestRootPath for directory replacements and added wikiTestRootPath to paths.ts for clarity. Improved error handling and directory logic in watch-filesystem-adaptor.ts, including saving tiddlers directly to sub-wiki folders, more informative logging, and ensuring cleanup after file writes is properly awaited.
* rename
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* feat: basic watch-fs
* feat: check file not exist
* refactor: use exponential-backoff
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* Initial commit when init a new git.
* fix: cleanup
* Refactor test setup and cleanup to separate file
Moved Before and After hooks from application.ts to a new cleanup.ts file for better organization and separation of concerns. Also removed unused imports and related code from application.ts. Minor type simplification in agent.ts for row parsing.
* test: modify and rename
* feat: enableFileSystemWatch
* refactor: unused utils.ts
* Update watch-filesystem-adaptor.ts
* refactor: use node-sentinel-file-watcher
* refactor: extract to two classes
* The logFor method lacks JSDoc describing the level parameter's
* Update startNodeJSWiki.ts
* fix: napi build
* Update electron-rebuild command in workflows
Changed the electron-rebuild command in release and test GitHub Actions workflows to use a comma-separated list for native modules instead of multiple -w flags. This simplifies the rebuild step for better-sqlite3 and nsfw modules.
* lint
* not build nsfw, try use prebuild
* Update package.json
* Update workerAdapter.ts
* remove subWikiPlugin.ts as we use new filesystem adaptor that supports tag based sub wiki
* fix: build
* fix: wrong type
* lint
* remove `act(...)` warnings
* uninstall chokidar
* refactor and test
* lint
* remove unused logic, as we already use ipc syncadaptor, not afriad of wiki status change
* Update translation.json
* test: increast timeout in CI
* Update application.ts
* fix: AI's wrong cleanup logic hidden by as unknown as
* fix: AI's wrong as unknown as
* Update agent.feature
* Update wikiSearchPlugin.ts
* fix: A dynamic import callback was not specified.
* docs: deps
* Update dependencies and type usage for AI features
Upgraded multiple dependencies in package.json and pnpm-lock.yaml, including @ai-sdk, @mui, react, and others for improved compatibility and performance. Changed type usage from CoreMessage to ModelMessage in mockOpenAI.test.ts to align with updated ai package. No functional changes to application logic.
* feat: i18n
* feat: test oauth login and use PKCE
* fix: use ollama-ai-provider-v2
* test: github and mock oauth2 login
* test: gitea login
* Refactor context menu cleanup and error message
Moved context menu cleanup for OAuth window to a single closed event handler in Authentication service. Simplified error message formatting in ContextService for missing keys.
* lint: AI fix
* Add tsx as a dev dependency and update scripts
Replaced usage of 'pnpm dlx tsx' with direct 'tsx' command in development and test scripts for improved reliability. Added 'tsx' to devDependencies in package.json.
* refactor: only use message id
* feat: stream update, but react don't react on it dny
* feat: start stop
* feat: basic resoponse handlers
* feat: load handler config schema
* chore: upgrade to "moduleResolution": "bundler"
* fix: prompt concat
* feat: rjfs with mui
* fix: mui v7 upgrade
* fix: field editor tabs
* feat: Description field is i18n key, use i18nAlly extension to see it on VSCode. And use react-i18next to translate it on frontend.
* refactor: extract some shared components
* refactor: remove @mui/lab
* feat: faster editor
* feat: beautify editor
* refactor: better style
* fix: fullscreen style
* fix: array sort
* fix: editor not saved
* fix: broken array
* chore: upgrade mui deps
* Update type.d.ts
* feat: upgrade and install react dev tools
* refactor: simplify the code
* refactor: simplify the code
* refactor: simplify ai generated garbage code
* fix: translated label
* feat: translate enum and conditional show field based on enum
* feat: click to open source
* fix: ai generated garbage code to solve id and index problem
* refactor: simplify
* refactor: shorten
* test: add jest
* chore: node-linker=hoisted as electron forge suggested
* test: e2e
* fix: test failed on ci
* test: faster by disable some typecheck
* fix: ci
* fix: ci
* refactor: remove unused
* fix: use macos and take screenshot in ci
* docs:
(cherry picked from commit b1a9706264)
* fix: ci crash due to no dugite binary, due to NODE_ENV=test not set
* Update test.yml
* fix: ci
* Update release.yml
* docs: test
* refactor: move folders and lint
* refactor: organize pages to reduce level
* refactor: merge page service and workspace service to allow drag & drop of pages
* Update ipc-syncadaptor.ts
* Update browserViewMetaData.ts
* fix: view.webContents.loadURL won't reload on new electron version
* fix: try to disable annoying useless disabling pasting "feature"
https://github.com/electron/electron/issues/40995
* fix: initial page
* feat: allow sort add icon
* test: use vitest instead
* refactor: use emotion instead
* fix: all ts error after migrate to vitest and emotion
* fix: Component selectors can only be used in conjunction with @emotion/babel-plugin, the swc Emotion plugin, or another Emotion-aware compiler transform.
fix by not using this usage
* fix: too many open files
* test: add basic main page test
* refactor: split workspace type to make it more specific
* test: support mock react lazy import component by re-export them
* test: sidebar
* refactor: move mock to global
* test: testing library fix
* test: new wiki form
* docs: test with vitest
* lint: fix
* docs: pronounication & remove toc as gh build in
* feat: tools and rag
* feat: prompt for build-in tools
* fix: i18n
* fix: tool using
* test: fix
* refactor: Auto-create default wiki workspace if none exists (handled in backend)
* fix: create wiki workspace so it is on first one
* refactor: remove some useless feature
* refactor: use plugin instead of handler
* chore: make concatPrompt async iterator
* feat: show progress on frontend
* fix: errors
* fix: ConfigError: Config (unnamed): Key "overrides": This appears to be in eslintrc format rather than flat config format.
* Update package.json
* feat: allow windows to hide titlebar
* fix: logger error when ctrl+c on mac
* lint
* refactor: use plugin everywhere
* refactor: move more logic to plugin
* refactor: run tool in plugin, simplify abstraction
* refactor: remove ai generated duplicate
* refactor
* refactor: less plugins
* test: simplify wiki search test
* test: remove any
* fix: not streaming, tool order wrong
* test: plugin system and streaming
* refactor: remove useless auto reply plugin
* fix: hide duration expired tool calling message, so long tool result only show to ai once
* fix: $ props should lower cased
* test: support run as electron so can use sqlite3 compiled bin for electron
* docs: better electron as node run and doc
* test: restore to use threads instead of fock. Seems this also works for inmemory database
* test: fix frontend ui test
* lint: ai content
* test: fix coverage
* test: Refactor test mocks to dedicated __mocks__ directory
Moved common test mocks from setup-vitest.ts into separate files under src/__tests__/__mocks__ for better organization and maintainability. Updated documentation to reflect the new structure. Removed fileMock.js and updated setup-vitest.ts to import and use the new centralized mocks.
* Update ErrorDuringStart.md
* Update messageManagementPlugin.test.ts
* test: Fix Electron test process cleanup and update test config
Update test:unit script to use cross-env for ELECTRON_RUN_AS_NODE, ensuring child processes inherit the variable and preventing resource leaks. Remove manual process.env setting from vitest.config.ts and add documentation on handling related errors in Testing.md. Also, add 'hanging-process' reporter to Vitest config for improved diagnostics.
* fix: warning in test
* Create AgentInstanceWorkflow.md
* fix: duration bug
* fix: ai not response for tool result
* test: Add agent workflow feature and step definitions
Introduces a new Cucumber feature for agent workflow, including multi-round conversation and tool usage. Adds agent-specific step definitions for message input and chat history validation. Refactors application step definitions for improved selector handling and element interaction. Updates test scripts in package.json to include a preparation step for e2e tests.
* Update application.ts
* test: Add mock OpenAI server and tests
Introduces a MockOpenAIServer for simulating OpenAI chat completions, including tool call and tool result responses. Adds corresponding tests and updates vitest config to include tests in the features directory.
* test: simplify steps
* test: Add separate test userData and wiki folders
Introduces 'userData-test' and 'wiki-test' folders for test environments, updating appPaths, fileNames, and paths constants to distinguish between development and test modes. This helps prevent conflicts when running test and development instances simultaneously.
* Update eslint.config.mjs
@typescript-eslint/no-unnecessary-condition': 'off'
* test: Add data-testid attributes for test automation
Added data-testid attributes to form inputs and buttons in ExternalAPI components to improve test automation reliability. Updated feature files and step definitions to use these selectors, refined window switching logic, and improved timing for UI interactions. Also exposed isElectronDevelopment and added isMainWindowPage utility for window identification.
* test: fix wront page type by ai written garbage code
* Update application.ts
* Update Testing.md
* fix: no log during e2e test, and error creating wiki blocks other init steps
* test: click agent workspace button, and refactor mock server
* test: mock streamable openai api
* rename
* chore: try esbuild loader, renderer build too slow
* chore: organize webpack
* chore: ignore service code from hot reload
* Update Testing.md
* test: use full agentinstance in test
* chore: webpack error
* Update Testing.md
* chore: remove useless spectron
* test: EsbuildPlugin's `define` doesn't work, it won't set env properly.
* test: e2e mock openai
* lint: disable @typescript-eslint/require-await
* test: Add quick access to create default agent tab
Introduces a 'Create Default Agent' quick access button in the Agent New Tab page, with localization support. Adds utility to close all tabs and create a default agent tab for fallback scenarios, improves test selectors for tab and close actions, and refactors agent chat tab creation logic for consistency and testability.
* feat: remove unuse favorite
* feat: Add wiki operation and workspaces list plugins
Introduces wikiOperationPlugin and workspacesListPlugin for agent instance prompt and response handling. Updates plugin registry, test coverage, and default agent configuration to support wiki workspace listing and wiki note operations (create, update, delete) via tool calls. Refactors wikiSearchPlugin to delegate workspace list injection to workspacesListPlugin.
* Refactor plugin schema system for dynamic registration
Introduces a dynamic plugin schema registry, allowing plugins to register their parameter schemas and metadata at runtime. Refactors prompt concat schema generation to use dynamically registered plugin schemas, removes static plugin schema definitions, and updates all plugin files to export their parameter schemas. Adds new modelContextProtocolPlugin and schemaRegistry modules, and updates plugin initialization to register schemas and metadata. This enables extensibility and type safety for plugin configuration and validation.
* refactor: move PromptConfigForm to inside PromptPreviewDialog
* test: frontent render tool usage info
* test: split file
* test: fix error
* test: wiki operation
* test: remove log and clean up test deps
* Update i18next-electron-fs-backend.ts
* fix: wikiOperationInServer not called due to no message
* test: fix
* test: Refactor agent feature setup and improve mock server URL handling
Moved AI provider and model configuration to a shared setup scenario in agent.feature to avoid redundant steps in each test. Enhanced application.ts to use a fallback localhost URL for MOCK_SERVER_URL when the mock server is not available, improving test reliability.
* Remove retry logic from basicPromptConcatHandler
Eliminated retryCount and maxRetries from basicPromptConcatHandler, simplifying the control flow and removing the retry limit for LLM calls. Logging and yield logic were updated to reflect the removal of retries.
* Update agent.feature
* test: agent and default wiki
* test: refactor wiki cleanup
* Update agent.feature
* Refactor AI settings setup and add preference feature
Moved AI provider and model configuration steps from agent.feature to a new preference.feature file for better separation of concerns. Updated step definitions in agent.ts to improve robustness when reading and writing settings files, including type usage and directory checks.
* test: try debug can't stop bug
* Update Testing.md
* fix: cancel agent not update cancel button
* refactor: update Frontend use `void window.service.native.log` to log to file.
* test: log from renderer test
* feat: add default embedding model config and victor search service and search preference panel
* test: default embedding form and
* test: default agent
* refator: unused tool listing methods
* Refactor test database setup for integration tests
Centralizes in-memory SQLite test database initialization and cleanup in shared utilities for all integration tests. Updates agentDefinition and messageManagementPlugin tests to use the shared test database, improving reliability and reducing code duplication.
* fix: app path wrong in unit test
* feat: externalAPIDebug
* test: embedding service and let db use real in memory one
* test: provide at least one tab for close tab test
* fix: victor db not loaded in new connection
* test: disable hot reload
* Update DeveloperTools.tsx
* feat: tool message & wiki tool schema
* feat: pref to open db
* chore: skip ExternalsPlugin on dev
* fix: APIs doesn't accept 'tool' role, and it won't return anything when API calls
* fix: docs and remove ai fake fix
* refactor: get agent list don't need to have message
* Update basicPromptConcatHandler.failure.test.ts
* Update basicPromptConcatHandler.test.ts
* fix: role wrong cause e2e failed
* test: allow e2e create .db file to check
* feat: create new agent
* feat: getAgentDefinitionTemplatesFromWikis
* fix: Prevent update non-active (hiding) wiki workspace, so it won't pop up to cover other active agent workspace
* fix: Ensure the config change is fully persisted before proceeding
* test: Don't bring up window when running e2e test, otherwise it will annoy the developer who is doing other things.
* feat: Edit existing agent definition workflow
* Update StyledArrayContainer.tsx
* test: prevent mock server hang
* Refactor UI step definitions into separate file
Moved UI-related Cucumber step definitions from application.ts to a new ui.ts file for better separation of concerns and maintainability. application.ts now only contains application-specific logic.
* lint: ai auto fix
* Clean up feature files and improve test coverage
Removed unnecessary blank lines and improved formatting in feature files for better readability. Updated tsconfig to use 'bundler' module resolution. Enhanced EditAgentDefinitionContent test to mock and verify console.error output. Added type annotation for IAgentDefinitionService in basicPromptConcatHandler.failure.test.ts for improved type safety.
* test: simplify message text match
* feat: transcription and image generation model config
* fix: style props error
* chore: remove unused file
* chore: try to imporove dev start speed but no sig improvment
Replaces 'pnpm start' with 'pnpm start:init' for initial setup and documents slow startup in development. Adds a debug Webpack script, disables polling in renderer file watching, and only enables CircularDependencyPlugin in production/CI for faster dev builds. WebpackBar now only shows when DEBUG includes 'electron-forge:*'. ForkTsCheckerWebpackPlugin is now configured for async checks with memory limits and test file exclusion. Updates documentation to reflect these changes.
* docs: why not vite
* refactor: basic vite usage, but wiki worker is not running and view is not showing
* refactor: remove lazy inject so vite works and wiki worker works, wiki in browser view can loads
* Replace electron-squirrel-startup with inline implementation
Added a custom Squirrel event handler in src/helpers/squirrelStartup.ts to handle Windows install/update/uninstall events, replacing the electron-squirrel-startup package. This avoids ESM/CommonJS compatibility issues and simplifies event handling in src/main.ts.
* refactor: vite build and test
* fix: e2e still use dev wiki folder
* fix: provide env
* chore: "tiddlywiki": "5.3.7"
* Apply suggestion from @Copilot
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Apply suggestion from @Copilot
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Apply suggestion from @Copilot
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Apply suggestion from @Copilot
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* fix: missing i18n
* test: Module did not self-register: '/home/runner/work/TidGi-Desktop/TidGi-Desktop/node_modules/better-sqlite3/build/Release/better_sqlite3.node'.
* feat: i18n
* feat: zh-Hant i18n
* Update test.yml
* feat: zh-Hans in test
* test: i18n
* refactor: ts forge config
* lint: fix
* chore: update wiki
* Update pnpm-lock.yaml
* chore: update github action versions
* Update wiki
* fix: pnpm then node
* fix: Multiple versions of pnpm specified
* Update test.yml
* fix: Failed to take screenshot: page.screenshot: Target page, context or browser has been closed
* chore: CodeQL Action major versions v1 and v2 have been deprecated.
* chore: parallel codeql
* Update test.yml
* fix: i18n test not passing
* test: step screenshot in each folder
* fix: can't unzip, may due to file path
* test: increase timeout in CI
* docs: more log about wiki creation, and add log to criticial path
* Refactor: logging for structured and consistent output
Replaces string-based logger messages with structured logging throughout the codebase, providing function names, error messages, and relevant context as objects. This improves log readability, enables better filtering and searching, and standardizes error and debug reporting across services.
* chore: debug wiki copy
* fix: wiki submodule not cloned
* Revert "test: increase timeout in CI"
This reverts commit eff8583a01.
* test: reduce wait time, because most check already will wait for a while
* test: batch some e2e steps to reduce screenshot count
* Update index.ts
* chore: remove webpack files, use vite plugins
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
lin onetwo