Commit Graph

110 Commits

Author SHA1 Message Date
an-lee
3b83861749 Feat: customize settings before transcribing (#699)
* transcribe with language

* avoid using .en model to transcribe un-English audio

* save lanuage in transcription/audio/video

* may select language when regenerate transcription

* may select service when re-generate

* refactor transcription form

* refactor transcription create form

* refactor media loading modal

* display ipa per language

* refactor ipa mappings

* parse subtitle files
2024-06-24 14:35:09 +08:00
an-lee
75d379eb86 fix migration resolver in win32 (#696) 2024-06-20 22:41:39 +08:00
an-lee
c50e5abf7b Fix whisper should abort when cancel (#692)
* add whisper abort

* abort whisper when exit meida page

* add abort controller for youtubedr
2024-06-20 14:23:11 +08:00
an-lee
814be8369d Refactor current recording component (#691)
* upgrade deps

* update buttons order

* auto assess when modal open

* display assess score in recording list

* display assess mark on transcription list

* auto scroll to current segment

* toast may close

* update ui components
2024-06-20 13:25:56 +08:00
an-lee
fad4a219a1 Fix player unfuntional hotkeys (#679)
* upgrade deps

* fix react warning

* hotkeys for play/pause recording

* tune recording trim

* refactor hotkeys
2024-06-17 13:19:44 +08:00
an-lee
e124609437 Feat: unscripted pronounciation assessment (#666)
* clean code

* add pronunciation assessment page

* load assessments

* recording target constraint

* display assessment card

* update style

* may check assessment detail

* fix style

* add new assessment page

* update pronunciation assessment form

* add language column to models

* create pronunciation assessment

* upload file to assess

* locales

* add source for assessment

* display language
2024-06-13 12:55:11 +08:00
an-lee
14a44752b1 Feat: support action cable (#665)
* upgrade deps

* may connect server via cable
2024-06-09 14:07:30 +08:00
an-lee
9de34745c7 Improve some default setting & err message (#656)
* use azure as default stt engine for new user

* refactor recording saving

* tune recording trimming

* fix recording err msg
2024-06-05 10:57:19 +08:00
an-lee
d8231ca97c Feat: Settings for learning lang (#641)
* refactor settings

* refactor constants

* add settings for native/learning language

* setup langugage for transcribe

* use 2 letter code for echogarden

* AI commands support multiple language

* update languages constant

* fix sentry error

* fix context menu

* show camdict when only learning English

* add en-GB

* recording assess support multiple languages

* fix ai command

* refactor
2024-05-29 15:13:52 +08:00
an-lee
2fea45fb32 fix test 2024-05-21 16:28:45 +08:00
an-lee
9f48a8f6bd validate conversaton configuation & handle preset loading in poor network (#624) 2024-05-21 15:48:20 +08:00
an-lee
cdbaf89005 Fix: handle echogarden align error (#620)
* may re-generate when "no matching voice found"

* may regenerate if the original text has not-matching voice

* specify language to avoid "no matching voice found"
2024-05-20 10:30:28 +08:00
an-lee
2d58c9ac63 Fix audible provider & add more YT channel (#618)
* add more youtube channel

* fix audible provider

* fix youtube video card style
2024-05-17 11:36:35 +08:00
an-lee
61c76006fd Feat: more settings for ai engine & models (#611)
* may setup gpt ai engine & model

* ai models setting works

* update openai setting

* validate engine setting before save

* fail fast

* clean code

* refactor gpt preset
2024-05-15 15:52:07 +08:00
an-lee
156222f28c Feat: may download segment (#601)
* may download segment audio

* display original audio with the recording in post
2024-05-13 10:25:28 +08:00
an-lee
8afb942f97 Chore: refactor (#596)
* use WebContentView instead of deprecated BrowserView API

* refactor providers

* fix forwardRef warning
2024-05-10 14:50:35 +08:00
an-lee
107fa97816 Fix recording incomplete (#591)
* upgrade deps

* disable denoise for recording
2024-05-07 15:11:18 +08:00
Harry
eda603efce fix youtubedr dir (#584) 2024-05-04 16:30:18 +08:00
an-lee
7517fe2a80 Chore update constants (#576)
* support multiple base url

* use hf-mirror.com for model download host
2024-04-28 15:17:19 +08:00
an-lee
3d53c2dd74 extname should support uppercase (#569) 2024-04-26 16:38:11 +08:00
an-lee
0644c3bbd7 Feat: make notes on caption (#544)
* add segment model

* add note model

* db handle segment & note

* add notes & segments handler

* refactor media caption components

* segment & note create

* fix type

* update note column & may sync

* display selected words for note

* refactor selected words

* auto select words when editing note

* refactor

* refactor caption component

* display notes

* refactor notes components

* fix

* refactor segment & notes into context

* destroy note

* update locale

* fix caption switch issue

* fix layout

* refactor caption layout

* remove deprecated code

* may share note

* improve UI

* fix notes list auto update after created

* remove console.log

* add notes page

* refactor note parameters

* refactor components

* mark note on transcription

* handle no notes

* improve style

* improve style

* show context menu on selection text

* fix utils
2024-04-26 15:05:36 +08:00
an-lee
84792e5882 whisper use auto language config when using none .en model (#542) 2024-04-19 20:40:22 +08:00
an-lee
e4f5bdcfb9 Refactor components codes (#538)
* remove deprecated code

* refactor code

* refactor components codes

* fix renderer tests
2024-04-19 10:46:04 +08:00
an-lee
8947b66007 upgrade echogarden dep (#535)
* upgrade echogarden dep

* avoid duplicate render when after recording

* update trim threshold when compare recording

* update recording trim threhold when saving
2024-04-17 10:37:30 +08:00
an-lee
1c3b148e9a Update auto updater config (#514)
* update autoupdater config

* update deps

* update window size
2024-04-12 09:29:40 +08:00
an-lee
39c55b5f3f Feat: publish to s3 & auto update (#511)
* publish to s3

* add update base url

* autoupdate from s3

* fix warning

* update locales

* update publish workflow
2024-04-11 21:37:48 +08:00
an-lee
ac39ccaf6f Improve layout (#510)
* fix assessment layout

* improve player layout

* refactor sidebar

* default system theme

* may toggle theme

* fix calendar in dark theme

* fix style in dark mode

* improve player layout
2024-04-11 16:03:17 +08:00
slarkvan
5b87d218ac Feat/custom hotkeys (#496)
* feat: 2024-04-07 15:27:52 - custom hotkeys

* feat: 2024-04-07 15:52:13 - add custome compare shortcuts

* feat: 2024-04-09 10:17:23 - Modify the code according to the code review suggestions and optimize the experience.

---------

Co-authored-by: more.tai <more.tai@huolala.cn>
2024-04-09 14:52:51 +08:00
an-lee
a3a240da56 no need to upload before recording assess 2024-04-08 10:44:11 +08:00
an-lee
1a4df1426b ensure recording is synced before share (#492) 2024-04-07 14:51:32 +08:00
Harry
2166a4aaf2 Feat: Add progress bar to Youtube download (#481)
* download progress on console

* Feat: add a progress bar to Youtube download

* change download-on-state to interrupted if download failed
2024-04-03 07:01:01 +08:00
an-lee
f0f4319044 Refactor transcription (#476)
* word-level timestamp is not needed for alignment

* remove deprecated code

* fix error when stop recording
2024-04-02 14:03:02 +08:00
Harry
f4d1d2a730 Feat: add youtube provider (#475) 2024-04-02 13:51:43 +08:00
an-lee
265429a24e Feat: denoise recording & clean code (#473)
* denoise recording before saved

* Refactor audio processing and recording logic

* Remove unused code

* use echogarden to transcode

* remove ffmpeg-wasm

* add echogarden decode

* remove deprecated code

* ensure use posix path

* refactor echogarden transcode

* refactor recording denoise

* clean code

* expose align error in toast

* remove unused code
2024-04-02 11:10:19 +08:00
an-lee
e63d77cd82 Fix layout (#454)
* player layout autosize

* fix video layout

* improve style
2024-03-28 10:35:32 +08:00
an-lee
b82b847d59 fix camdict in package 2024-03-23 18:18:28 +08:00
an-lee
3600895a60 Feat: add camdict (#435)
* add camdict db & logic

* refactor camdict

* refactor media caption

* display camdict result
2024-03-23 17:46:26 +08:00
an-lee
8fc8905afc Feat: may download files(recording/audio/video/speech) (#431)
* may download recording

* may download recording/audio/video/speech
2024-03-22 08:44:48 +08:00
an-lee
1e0caf0cb1 add basic context menu (#424) 2024-03-18 14:58:19 +08:00
an-lee
de89ae73bf Force alignment for tts audio (#418)
* add originalText as param

* save original text when added from tts speech

* fix player in conversation sheet

* minor fix
2024-03-18 12:55:28 +08:00
an-lee
0f9c788aa4 add more logs for echogarden 2024-03-17 10:56:20 +08:00
an-lee
d516530440 fix ffmpeg path for echogarden 2024-03-17 10:37:15 +08:00
an-lee
df2aac185a upgrade echogarden 2024-03-17 10:32:03 +08:00
an-lee
90f38e9226 Transcription force alignment & more (#416)
* add wavesurfer-provider

* brand new layout for player

* refactor pitch contour

* clean up

* update styl

* refactor

* update layout

* use new layout for video

* refactor

* may select word

* may edit word timestamp

* may toggle multiselect words

* clean code

* improve word region update

* improve layout

* update layout

* add echogarden

* fix test

* use aligned transcription

* fix ipa

* some refactor

* improve code

* implement ipa & translate & lookup

* recording play & share

* fix

* fix post audio

* improve layout

* may delete recording

* may record

* fix video player layout

* fix player in conversation

* render recording along with orignal audio

* may custom create region in recording

* fix float issue when seekTo

* fix recording player

* fix load more recordings

* fix seekTo

* clean up

* refactor pitch contour

* fix some warnings

* upgrade deps

* fix group transcription sentence

* zoom to fit when segment update

* add more hotkeys

* update player layout

* improve style

* play recording overlap audio when comparing

* update echogarden dep

* add recorded mark on transcription

* fix recording pitch contour rendering

* improve recording

* adjust pitch finder params
2024-03-16 19:42:37 +08:00
an-lee
e8bea7cb0f specify target when generate azure token 2024-03-04 09:26:44 +08:00
an-lee
240c9d7e89 config asar when package 2024-03-01 19:43:14 +08:00
an-lee
ded7371be6 Feat: integrate deposit (#363)
* create deposit payment

* display recent deposits & improve UI

* support Mixin pay
2024-02-28 15:29:07 +08:00
an-lee
ce47c8e138 Deps: upgrade deps & use ESM (#343)
* upgrade deps

* upgrade forge

* make app work in ESM

* fix CI
2024-02-23 16:03:39 +08:00
an-lee
74e061ccac fix messages findOne (#342) 2024-02-22 22:17:46 +08:00
an-lee
8037273549 Feat: add tts conversation (#341)
* may create tts type conversation

* support tts reply

* upgrade deps

* test: e2e for create TTS conversation

* test: e2e for gpt conversation

* test: e2e for from create conversation to add speech audio to library

* refactor use-conversation

* generate speech before create msg in tts conversation

* refactor conversation-shorts

* revert change in 1000-hours

* revert sass dep changed in 1000-hours

* fix CI
2024-02-22 16:00:17 +08:00