Commit Graph

62 Commits

Author SHA1 Message Date
an-lee
e785d523a0 Feat: remove recordings in bulk (#1128)
* support soft delete recording

* delete recordings in bulk

* bulk delete recordings

* auto delete recordings without file
2024-10-15 09:33:52 +08:00
an-lee
d96c9ff773 Refactor Chat (#1108)
* modify chat table & migrate

* refactor layout

* update layout

* actions for chats & agents

* refactor chat form

* refactor chat form

* update chat form

* rename

* refactor types & locales

* refactor tts engine

* refactor

* fix config

* refactor chat form

* refactor chat member form

* fixing

* refactor ask agent

* chat in conversation

* fix chat message update

* may update chat member

* update chat member from message

* refacto group propmt

* chat member gpt settings

* update ui

* more config for chat

* add locales

* update chat agent form

* add locales for agent form

* update UI

* auto reply for text input

* update chat

* update chat input

* rename colomns

* update chat

* udpate agent message

* add chat member

* add/remove chat member

* fix chat member

* refactor

* auto update chat name

* fix chat update

* refactor chat column

* fix chat

* add agent loading

* use fresh new prompt when ask agent

* add chat forwarder

* refactor chat

* fix

* add copilot

* toggle copilot

* add copilot chat

* avoid open the same chat at the same time

* update copilot header

* add agent introduction in the first place of chat

* rename column

* update style

* refactor

* invoke all agents in group after asking

* chat sidebar collopse

* may select chat in copilot

* update ui

* new chat from agent

* upgrade deps

* refactor chat & chatAgent

* add limit for chat member create

* update chat form

* update db & migration

* fix up

* fix group chat

* fix panel warning

* display chat agent type

* tts message

* fit tts agent

* refactor

* chat fowarder

* update UI

* setup default values for tts agent

* fix chat member add/remove

* edit tts agent

* display chat date

* Fix UI

* add system message

* refactor

* fix hook

* refactor

* touch chat&agent when new message created

* fix auto reply

* migrate conversation to chat

* add migrate api

* fix migrate

* update migrate

* refactor

* refactor

* refactor

* fix delete agent

* add hotkey for copilot

* fix bugs

* upgrade deps

* refactor tts hook

* stop auto playback when azure transcribed

* refactor

* clean up

* fix UI

* fix conversation migrate

* handle error

* update model

* declare types

* audo backup db file when started

* fix db backup

* refactor db migration

* fix UI

* refactor

* fix chat auto update name

* fix authorization lost when hot reload

* refactor

* refactor

* fix tts form

* keep agent avatar up to date

* clean code
2024-10-09 16:57:32 +08:00
divisey
8148a8679d feat: 🎸 update dicts (#1062) 2024-09-12 10:40:52 +08:00
an-lee
f7d02f8edd Feat: export recordings in one file (#1050)
* auto reconnect db

* may export & merge recordings
2024-09-07 19:33:00 +08:00
an-lee
fffb97f8dc Improve: use database to save user settings (#1041)
* add user settings

* fix user setting

* migrate dict settings

* migrate hotkeys

* fix hotkey setting

* update library settings

* migrate gpt Engine

* use user setting key enum

* migrate openai

* migrate more settings

* migrate whisper config

* migrate whisper

* refactor

* clean up

* migrate profile

* migrate recorder config

* refactor

* refactor

* fix e2e

* add api status

* fix e2e

* fix app init

* fetch apiUrl before fetch user

* update stt engine enums

* update enums

* update enums

* refactor login flow

* Fix warning

* Login from remembered users

* fix e2e

* refactor

* add unauthorized alert

* feat: 🎸 dict import update (#1040)

* rectified. according to Issues.

* issue #1025

* feat: add Vietnamese language to support (#1043)

* feat: add vietnamese language to support

* fix: update Vietnamese language name to native form

---------

Co-authored-by: Ryan <trongdv@coccoc.com>

* upgrade deps

* update locales

---------

Co-authored-by: divisey <18656007202@163.com>
Co-authored-by: xiaolai <lixiaolai@gmail.com>
Co-authored-by: ryan <69750456+ryangwn@users.noreply.github.com>
Co-authored-by: Ryan <trongdv@coccoc.com>
2024-09-06 18:32:09 +08:00
divisey
895d44f60b feat: 🎸 dict import update (#1040) 2024-09-04 15:05:34 +08:00
divisey
e16990a8b4 feat: 🎸 word lookup, remove dict download (#1038) 2024-09-03 20:03:07 +08:00
divisey
a1e7b7a062 feat: 🎸 add dicts (#1022) 2024-08-29 14:02:52 +08:00
an-lee
04a4f9b296 display library disk usage (#976) 2024-08-15 17:18:12 +08:00
an-lee
7da9fb8095 Improve audio video page (#975)
* remember tab value

* fix locale

* tips for no source file resources

* add alert for no source file

* improve code

* clean up resources
2024-08-15 15:12:52 +08:00
an-lee
1e0297f8f7 Feat: voice chat with AI (#898)
* add chats page

* add basic layout and types

* add chat context

* add more components

* add agent form

* add destroy button

* update types

* add models

* update chat agent

* create chat agent

* refactor

* refactor

* add chats CRUD

* notify for chat db update

* refactor

* typo

* chat CRUD

* refactor

* clean code

* add vad

* may record

* may transcribe recording

* update models

* edit chat member

* chat form update

* refactor

* fix chat form

* transcribe in chat

* create chat session

* may create chat session

* update

* update chat

* locale

* refactor

* refactor

* update

* update

* update

* refactor chat

* Fix

* fix

* update prompt

* refactor

* make it works

* update agent message actions

* may assess recording

* fix chat message recording assess

* refine

* refactor

* refactor

* may delete message

* may edit message

* update locales

* fix package issue in Mac

* add destroy callbacks

* fix chats CRUD

* update chats

* add quickstart

* update locales

* refactor

* refactor prompt

* remove console.log

* update

* fix locales
2024-08-13 16:09:44 +08:00
divisey
e5a328e284 feat: 🎸 add net state (#947) 2024-08-08 14:22:27 +08:00
an-lee
4511d50df5 Improve alignment (#886)
* refactor wordTimeline to sentenceTimeline

* fix twinkle

* fix azure ai

* refactor

* clean code

* refactor cloudflare stt
2024-07-25 13:44:38 +08:00
an-lee
078f5159ff Feat: Improve alignment for the audio with background noise (#870)
* use echogarden.alignSegments

* fix cloudflare whisper

* refactor azure ai transcribe

* refactor

* fix align result

* refactor

* edit transcription in srt format

* improve timeline

* refactor

* fix update current segment index

* validate text when use upload transcript

* add form description

* refactor codes

* do not change sentence timeline based on word timeline
2024-07-23 15:24:24 +08:00
an-lee
223ae743ed Feat may set api url (#850)
* add api url settings

* may edit api setting before login
2024-07-20 17:18:33 +08:00
an-lee
93d9e190e2 Refactor pronunciation assess (#820)
* refactor pronunciation assessment request

* remove unused code
2024-07-17 17:25:42 +08:00
divisey
1899f26a83 feat: 🎸 add transcription export (#814) 2024-07-16 18:28:47 +08:00
an-lee
728bfae82f Feat: interactive courses (#736)
* add courses page

* add api for courses

* add course page

* update course type

* update client

* update course page

* refactor courses pages

* render chapter content

* shadow in course

* fix video handler

* update style

* mark finished examples

* fix media player

* update locale

* finish chapter

* refactor

* auto update chapter status

* audo finish chapter

* fix media provider

* fix wavesurfer player

* update continue btn

* refactor chapters & page

* minor fix

* fix undefined

* refactor

* refactor

* disable sentry in dev

* clean markdown format before alignment

* refactor

* fix regenerate

* fix transcription pre-process for `-` connector

* upgrade deps

* handle no chapters

* add llm chat api

* create llm chat

* display llm message

* create message

* handle error

* generate llm message

* display llm datetime

* scroll to message

* tts for llm message

* add course provider

* refactor

* translate llm message

* fix llm chat introduction

* refacotr

* upgrade deps

* refactor style

* handle undefined

* fix posts

* update locales

* update courses api

* add enrollments count

* upgrade yarn

* upgrade deps

* restore dep to fix package in mac

* upgrade deps
2024-07-11 19:14:40 +08:00
an-lee
f440947ea0 Improve stt (#764)
* refactor

* add isolate option for alignment

* setup isolate for alignment

* refactor transcription form

* add transribing output

* update locale

* refactor

* display transcribing output

* cannot cancel when transcribing
2024-07-03 11:19:44 +08:00
an-lee
3b83861749 Feat: customize settings before transcribing (#699)
* transcribe with language

* avoid using .en model to transcribe un-English audio

* save lanuage in transcription/audio/video

* may select language when regenerate transcription

* may select service when re-generate

* refactor transcription form

* refactor transcription create form

* refactor media loading modal

* display ipa per language

* refactor ipa mappings

* parse subtitle files
2024-06-24 14:35:09 +08:00
an-lee
c50e5abf7b Fix whisper should abort when cancel (#692)
* add whisper abort

* abort whisper when exit meida page

* add abort controller for youtubedr
2024-06-20 14:23:11 +08:00
an-lee
e124609437 Feat: unscripted pronounciation assessment (#666)
* clean code

* add pronunciation assessment page

* load assessments

* recording target constraint

* display assessment card

* update style

* may check assessment detail

* fix style

* add new assessment page

* update pronunciation assessment form

* add language column to models

* create pronunciation assessment

* upload file to assess

* locales

* add source for assessment

* display language
2024-06-13 12:55:11 +08:00
an-lee
14a44752b1 Feat: support action cable (#665)
* upgrade deps

* may connect server via cable
2024-06-09 14:07:30 +08:00
an-lee
d8231ca97c Feat: Settings for learning lang (#641)
* refactor settings

* refactor constants

* add settings for native/learning language

* setup langugage for transcribe

* use 2 letter code for echogarden

* AI commands support multiple language

* update languages constant

* fix sentry error

* fix context menu

* show camdict when only learning English

* add en-GB

* recording assess support multiple languages

* fix ai command

* refactor
2024-05-29 15:13:52 +08:00
an-lee
2d58c9ac63 Fix audible provider & add more YT channel (#618)
* add more youtube channel

* fix audible provider

* fix youtube video card style
2024-05-17 11:36:35 +08:00
an-lee
61c76006fd Feat: more settings for ai engine & models (#611)
* may setup gpt ai engine & model

* ai models setting works

* update openai setting

* validate engine setting before save

* fail fast

* clean code

* refactor gpt preset
2024-05-15 15:52:07 +08:00
an-lee
156222f28c Feat: may download segment (#601)
* may download segment audio

* display original audio with the recording in post
2024-05-13 10:25:28 +08:00
an-lee
0e8de4881c Feat: lookup in context menu (#595)
* add lookup widget

* add lookup result

* refactor

* refactor

* add translate widget

* make translate widget works

* refactor locales

* typo

* remove deprecated component

* refactor lookup prompt
2024-05-10 11:16:38 +08:00
an-lee
0644c3bbd7 Feat: make notes on caption (#544)
* add segment model

* add note model

* db handle segment & note

* add notes & segments handler

* refactor media caption components

* segment & note create

* fix type

* update note column & may sync

* display selected words for note

* refactor selected words

* auto select words when editing note

* refactor

* refactor caption component

* display notes

* refactor notes components

* fix

* refactor segment & notes into context

* destroy note

* update locale

* fix caption switch issue

* fix layout

* refactor caption layout

* remove deprecated code

* may share note

* improve UI

* fix notes list auto update after created

* remove console.log

* add notes page

* refactor note parameters

* refactor components

* mark note on transcription

* handle no notes

* improve style

* improve style

* show context menu on selection text

* fix utils
2024-04-26 15:05:36 +08:00
an-lee
e4f5bdcfb9 Refactor components codes (#538)
* remove deprecated code

* refactor code

* refactor components codes

* fix renderer tests
2024-04-19 10:46:04 +08:00
an-lee
1c3b148e9a Update auto updater config (#514)
* update autoupdater config

* update deps

* update window size
2024-04-12 09:29:40 +08:00
an-lee
39c55b5f3f Feat: publish to s3 & auto update (#511)
* publish to s3

* add update base url

* autoupdate from s3

* fix warning

* update locales

* update publish workflow
2024-04-11 21:37:48 +08:00
slarkvan
5b87d218ac Feat/custom hotkeys (#496)
* feat: 2024-04-07 15:27:52 - custom hotkeys

* feat: 2024-04-07 15:52:13 - add custome compare shortcuts

* feat: 2024-04-09 10:17:23 - Modify the code according to the code review suggestions and optimize the experience.

---------

Co-authored-by: more.tai <more.tai@huolala.cn>
2024-04-09 14:52:51 +08:00
an-lee
1a4df1426b ensure recording is synced before share (#492) 2024-04-07 14:51:32 +08:00
Harry
f4d1d2a730 Feat: add youtube provider (#475) 2024-04-02 13:51:43 +08:00
an-lee
265429a24e Feat: denoise recording & clean code (#473)
* denoise recording before saved

* Refactor audio processing and recording logic

* Remove unused code

* use echogarden to transcode

* remove ffmpeg-wasm

* add echogarden decode

* remove deprecated code

* ensure use posix path

* refactor echogarden transcode

* refactor recording denoise

* clean code

* expose align error in toast

* remove unused code
2024-04-02 11:10:19 +08:00
an-lee
e63d77cd82 Fix layout (#454)
* player layout autosize

* fix video layout

* improve style
2024-03-28 10:35:32 +08:00
an-lee
3600895a60 Feat: add camdict (#435)
* add camdict db & logic

* refactor camdict

* refactor media caption

* display camdict result
2024-03-23 17:46:26 +08:00
an-lee
8fc8905afc Feat: may download files(recording/audio/video/speech) (#431)
* may download recording

* may download recording/audio/video/speech
2024-03-22 08:44:48 +08:00
an-lee
90f38e9226 Transcription force alignment & more (#416)
* add wavesurfer-provider

* brand new layout for player

* refactor pitch contour

* clean up

* update styl

* refactor

* update layout

* use new layout for video

* refactor

* may select word

* may edit word timestamp

* may toggle multiselect words

* clean code

* improve word region update

* improve layout

* update layout

* add echogarden

* fix test

* use aligned transcription

* fix ipa

* some refactor

* improve code

* implement ipa & translate & lookup

* recording play & share

* fix

* fix post audio

* improve layout

* may delete recording

* may record

* fix video player layout

* fix player in conversation

* render recording along with orignal audio

* may custom create region in recording

* fix float issue when seekTo

* fix recording player

* fix load more recordings

* fix seekTo

* clean up

* refactor pitch contour

* fix some warnings

* upgrade deps

* fix group transcription sentence

* zoom to fit when segment update

* add more hotkeys

* update player layout

* improve style

* play recording overlap audio when comparing

* update echogarden dep

* add recorded mark on transcription

* fix recording pitch contour rendering

* improve recording

* adjust pitch finder params
2024-03-16 19:42:37 +08:00
an-lee
74e061ccac fix messages findOne (#342) 2024-02-22 22:17:46 +08:00
an-lee
650a00b6a4 refactor transcode method 2024-02-20 09:00:58 +08:00
an-lee
f75912ff8b Feat use ffmpeg static (#327)
* use ffmpeg static if valid

* transcribe after decoded
2024-02-19 14:12:06 +08:00
an-lee
57d6efa547 Feat: refactor ffmpeg config (#296)
* bundle ffmpeg wasm in package

* remove ffmpeg discover & add ffmpeg-static

* fix ffprobe-static version

* fix metadata generate

* fix auto transcribe if pending

* remove console.log
2024-02-11 17:21:39 +08:00
an-lee
bc22a5e2b4 Feat: refactor STT service (#294)
* add stt hook interface

* fix crypto exported to browser

* refactor use-transcribe

* may use openai stt

* refactor: remove decprecated codes

* fix undefined method
2024-02-10 19:55:07 +08:00
an-lee
338ef82a1e Fix recording sync (#291)
* delete audio/video/recording in remote

* sync recordings on profile page

* handle recording sync failed
2024-02-09 18:24:36 +08:00
an-lee
a95c247c8c Refactor whisper config (#287)
* may use custom whisper exe

* refactor whisper config code

* display progress when using local whisper transcribe
2024-02-09 17:07:21 +08:00
an-lee
abde169ead Fix openai proxy (#244)
* add create messages in batch

* add use conversation

* update conversation shortcut

* add speech handler

* tts in renderer

* fix speech create
2024-02-02 00:41:23 +08:00
an-lee
51a810fdfd Feat: may setup proxy (#238)
* add https proxy

* remove proxy in renderer

* proxy work for openai request

* use proxyAgent to enable system proxy

* add proxy setting

* tweak proxy setting
2024-02-01 15:33:37 +08:00
an-lee
00cbc8403b Feat: add Enjoy AI as option (#206)
* add enjoyAI as option

* use enjoyai config

* may call enjoyai

* may set default ai engine

* refactor setting context

* refactor preferences

* add warning when openai key not provided

* tweak locale

* update duration for audio/video

* add balance settings

* may select ai role when create conversation

* may forward message from conversation

* tweak ui

* refactor transcribe method

* refactor ai commands to hooks

* fix webapi

* tweak playback rate options

* add playMode, next & prev, ref: #124

* upgrade deps

* may skip whisper model download

* audios/videos default order by updated_At
2024-01-31 00:04:59 +08:00