Commit Graph

66 Commits

Author SHA1 Message Date
an-lee
143e1862b5 add hotkey for playrate +/- (#969) 2024-08-14 18:46:22 +08:00
an-lee
dc23a23d5f Refactor recorder (#968)
* refactor recorder

* refactor recording for full transcription

* remove deprecated codes

* recording time limit

* refactor hotkey invoke
2024-08-14 18:30:31 +08:00
an-lee
dba24c5a57 Improve chat (#966)
* add text input for chat

* fix up

* fix message CRUD

* update chat message actions

* may cancel recording

* audio input as default

* fix quick start

* improve action icons

* update

* fix prompt preview

* add tool tips

* update style
2024-08-14 15:44:30 +08:00
an-lee
1e0297f8f7 Feat: voice chat with AI (#898)
* add chats page

* add basic layout and types

* add chat context

* add more components

* add agent form

* add destroy button

* update types

* add models

* update chat agent

* create chat agent

* refactor

* refactor

* add chats CRUD

* notify for chat db update

* refactor

* typo

* chat CRUD

* refactor

* clean code

* add vad

* may record

* may transcribe recording

* update models

* edit chat member

* chat form update

* refactor

* fix chat form

* transcribe in chat

* create chat session

* may create chat session

* update

* update chat

* locale

* refactor

* refactor

* update

* update

* update

* refactor chat

* Fix

* fix

* update prompt

* refactor

* make it works

* update agent message actions

* may assess recording

* fix chat message recording assess

* refine

* refactor

* refactor

* may delete message

* may edit message

* update locales

* fix package issue in Mac

* add destroy callbacks

* fix chats CRUD

* update chats

* add quickstart

* update locales

* refactor

* refactor prompt

* remove console.log

* update

* fix locales
2024-08-13 16:09:44 +08:00
an-lee
ab4322586c reload page when player error (#942) 2024-08-07 14:00:40 +08:00
an-lee
11e9f2a5d4 Fix AI engine setting for OpenAI (#894)
* fix default models settings

* fix type warning
2024-07-26 09:39:31 +08:00
an-lee
4511d50df5 Improve alignment (#886)
* refactor wordTimeline to sentenceTimeline

* fix twinkle

* fix azure ai

* refactor

* clean code

* refactor cloudflare stt
2024-07-25 13:44:38 +08:00
an-lee
7a7cf9e39b Fix some minor bugs (#880)
* avoid recording sync in the mean time

* update chapter title

* refactor transcription form

* refactor codes

* fix current segment index cached
2024-07-24 16:56:35 +08:00
an-lee
decea62b90 Feat update openai setting (#876)
* remove google ai

* update openAI models

* use custom models for openai
2024-07-24 11:34:06 +08:00
an-lee
6399022e5e display caption in video (#873) 2024-07-23 16:28:24 +08:00
an-lee
078f5159ff Feat: Improve alignment for the audio with background noise (#870)
* use echogarden.alignSegments

* fix cloudflare whisper

* refactor azure ai transcribe

* refactor

* fix align result

* refactor

* edit transcription in srt format

* improve timeline

* refactor

* fix update current segment index

* validate text when use upload transcript

* add form description

* refactor codes

* do not change sentence timeline based on word timeline
2024-07-23 15:24:24 +08:00
an-lee
223ae743ed Feat may set api url (#850)
* add api url settings

* may edit api setting before login
2024-07-20 17:18:33 +08:00
an-lee
93d9e190e2 Refactor pronunciation assess (#820)
* refactor pronunciation assessment request

* remove unused code
2024-07-17 17:25:42 +08:00
an-lee
898bd7b162 may retry when auto login failed (#808) 2024-07-15 15:39:42 +08:00
an-lee
8ea0667f53 fix recording compare (#802) 2024-07-15 10:35:24 +08:00
an-lee
728bfae82f Feat: interactive courses (#736)
* add courses page

* add api for courses

* add course page

* update course type

* update client

* update course page

* refactor courses pages

* render chapter content

* shadow in course

* fix video handler

* update style

* mark finished examples

* fix media player

* update locale

* finish chapter

* refactor

* auto update chapter status

* audo finish chapter

* fix media provider

* fix wavesurfer player

* update continue btn

* refactor chapters & page

* minor fix

* fix undefined

* refactor

* refactor

* disable sentry in dev

* clean markdown format before alignment

* refactor

* fix regenerate

* fix transcription pre-process for `-` connector

* upgrade deps

* handle no chapters

* add llm chat api

* create llm chat

* display llm message

* create message

* handle error

* generate llm message

* display llm datetime

* scroll to message

* tts for llm message

* add course provider

* refactor

* translate llm message

* fix llm chat introduction

* refacotr

* upgrade deps

* refactor style

* handle undefined

* fix posts

* update locales

* update courses api

* add enrollments count

* upgrade yarn

* upgrade deps

* restore dep to fix package in mac

* upgrade deps
2024-07-11 19:14:40 +08:00
an-lee
f440947ea0 Improve stt (#764)
* refactor

* add isolate option for alignment

* setup isolate for alignment

* refactor transcription form

* add transribing output

* update locale

* refactor

* display transcribing output

* cannot cancel when transcribing
2024-07-03 11:19:44 +08:00
an-lee
3b83861749 Feat: customize settings before transcribing (#699)
* transcribe with language

* avoid using .en model to transcribe un-English audio

* save lanuage in transcription/audio/video

* may select language when regenerate transcription

* may select service when re-generate

* refactor transcription form

* refactor transcription create form

* refactor media loading modal

* display ipa per language

* refactor ipa mappings

* parse subtitle files
2024-06-24 14:35:09 +08:00
an-lee
c50e5abf7b Fix whisper should abort when cancel (#692)
* add whisper abort

* abort whisper when exit meida page

* add abort controller for youtubedr
2024-06-20 14:23:11 +08:00
an-lee
8175a775c3 Feat: remember last active segment of audio/video (#681)
* remember last segment index for each audio/video

* fix for video

* auto scroll to cached segment
2024-06-17 16:28:51 +08:00
an-lee
fad4a219a1 Fix player unfuntional hotkeys (#679)
* upgrade deps

* fix react warning

* hotkeys for play/pause recording

* tune recording trim

* refactor hotkeys
2024-06-17 13:19:44 +08:00
an-lee
448ece4e7d refactor hotkey setting & add A hotkey (#676) 2024-06-14 10:55:32 +08:00
an-lee
14a44752b1 Feat: support action cable (#665)
* upgrade deps

* may connect server via cable
2024-06-09 14:07:30 +08:00
an-lee
d805ba7834 Fix ipa convert (#652)
* convert ipa for english only

* improve ipa convert
2024-06-04 14:08:57 +08:00
an-lee
d8231ca97c Feat: Settings for learning lang (#641)
* refactor settings

* refactor constants

* add settings for native/learning language

* setup langugage for transcribe

* use 2 letter code for echogarden

* AI commands support multiple language

* update languages constant

* fix sentry error

* fix context menu

* show camdict when only learning English

* add en-GB

* recording assess support multiple languages

* fix ai command

* refactor
2024-05-29 15:13:52 +08:00
an-lee
cdbaf89005 Fix: handle echogarden align error (#620)
* may re-generate when "no matching voice found"

* may regenerate if the original text has not-matching voice

* specify language to avoid "no matching voice found"
2024-05-20 10:30:28 +08:00
an-lee
47fe3f430d Fix unhandled errors (#617)
* fix undefined

* prevent story preview unless url provided

* refactor
2024-05-17 10:48:47 +08:00
an-lee
61c76006fd Feat: more settings for ai engine & models (#611)
* may setup gpt ai engine & model

* ai models setting works

* update openai setting

* validate engine setting before save

* fail fast

* clean code

* refactor gpt preset
2024-05-15 15:52:07 +08:00
an-lee
49dabc89a3 Update constants from api (#607)
* fix caption ipa display

* fetch gpt/tts providers from API

* fetch remote gpt presets

* update constants

* fix conversavtion save

* refactor ipa convert

* fetch ipa mapping from api

* fix ipa mark

* fix constant

* validate camdict pron audio src
2024-05-14 20:37:51 +08:00
an-lee
156222f28c Feat: may download segment (#601)
* may download segment audio

* display original audio with the recording in post
2024-05-13 10:25:28 +08:00
an-lee
69a6f721ca Feat summarize audio topic (#594)
* refactor ai commands

* fix json command

* fix extract story command

* may summarize topic for audio
2024-05-09 10:54:11 +08:00
an-lee
8799f5d479 Feat: may update transcription (#592)
* may update transcription

* update locales & ui

* transcription post process should not break transcription
2024-05-08 16:16:14 +08:00
an-lee
0644c3bbd7 Feat: make notes on caption (#544)
* add segment model

* add note model

* db handle segment & note

* add notes & segments handler

* refactor media caption components

* segment & note create

* fix type

* update note column & may sync

* display selected words for note

* refactor selected words

* auto select words when editing note

* refactor

* refactor caption component

* display notes

* refactor notes components

* fix

* refactor segment & notes into context

* destroy note

* update locale

* fix caption switch issue

* fix layout

* refactor caption layout

* remove deprecated code

* may share note

* improve UI

* fix notes list auto update after created

* remove console.log

* add notes page

* refactor note parameters

* refactor components

* mark note on transcription

* handle no notes

* improve style

* improve style

* show context menu on selection text

* fix utils
2024-04-26 15:05:36 +08:00
an-lee
ac39ccaf6f Improve layout (#510)
* fix assessment layout

* improve player layout

* refactor sidebar

* default system theme

* may toggle theme

* fix calendar in dark theme

* fix style in dark mode

* improve player layout
2024-04-11 16:03:17 +08:00
an-lee
7dfd47bb6d Refactor hotkey setting UI (#506)
* refactor hotkeys setting

* update UI

* refactor

* fix toast
2024-04-10 11:54:28 +08:00
slarkvan
5b87d218ac Feat/custom hotkeys (#496)
* feat: 2024-04-07 15:27:52 - custom hotkeys

* feat: 2024-04-07 15:52:13 - add custome compare shortcuts

* feat: 2024-04-09 10:17:23 - Modify the code according to the code review suggestions and optimize the experience.

---------

Co-authored-by: more.tai <more.tai@huolala.cn>
2024-04-09 14:52:51 +08:00
an-lee
265429a24e Feat: denoise recording & clean code (#473)
* denoise recording before saved

* Refactor audio processing and recording logic

* Remove unused code

* use echogarden to transcode

* remove ffmpeg-wasm

* add echogarden decode

* remove deprecated code

* ensure use posix path

* refactor echogarden transcode

* refactor recording denoise

* clean code

* expose align error in toast

* remove unused code
2024-04-02 11:10:19 +08:00
an-lee
ad5d4a6c37 fix style and ahoy configure 2024-03-29 09:19:52 +08:00
an-lee
3f6d26ee1a fix media decoding (#456) 2024-03-28 15:08:48 +08:00
an-lee
e63d77cd82 Fix layout (#454)
* player layout autosize

* fix video layout

* improve style
2024-03-28 10:35:32 +08:00
an-lee
cab66e6cd0 remove debug 2024-03-25 11:05:22 +08:00
an-lee
5ee7c78676 Feat: add tracking (#437)
* add ahoy

* add sentry for error tracking
2024-03-25 10:54:18 +08:00
an-lee
03d081592c Feat: improve player caption (#433)
* update ipa mapping

* refactor player caption layout
2024-03-22 10:20:13 +08:00
an-lee
6dac70daa4 Feat: improve player (#429)
* tune pitch params

* may generate meaning groups

* auto group words

* update caption style

* refactor caption

* add analysis

* use conversation to analyze

* fix caption tabs

* add command component
2024-03-21 11:10:00 +08:00
an-lee
3b770eaf3e Feat: handle decode errors (#425)
* show decode error

* handle loading error in post audio/recording

* tweak

* upgrade deps

* fix logout

* update build-enjoy-app.yml
2024-03-18 18:53:16 +08:00
an-lee
de89ae73bf Force alignment for tts audio (#418)
* add originalText as param

* save original text when added from tts speech

* fix player in conversation sheet

* minor fix
2024-03-18 12:55:28 +08:00
an-lee
90f38e9226 Transcription force alignment & more (#416)
* add wavesurfer-provider

* brand new layout for player

* refactor pitch contour

* clean up

* update styl

* refactor

* update layout

* use new layout for video

* refactor

* may select word

* may edit word timestamp

* may toggle multiselect words

* clean code

* improve word region update

* improve layout

* update layout

* add echogarden

* fix test

* use aligned transcription

* fix ipa

* some refactor

* improve code

* implement ipa & translate & lookup

* recording play & share

* fix

* fix post audio

* improve layout

* may delete recording

* may record

* fix video player layout

* fix player in conversation

* render recording along with orignal audio

* may custom create region in recording

* fix float issue when seekTo

* fix recording player

* fix load more recordings

* fix seekTo

* clean up

* refactor pitch contour

* fix some warnings

* upgrade deps

* fix group transcription sentence

* zoom to fit when segment update

* add more hotkeys

* update player layout

* improve style

* play recording overlap audio when comparing

* update echogarden dep

* add recorded mark on transcription

* fix recording pitch contour rendering

* improve recording

* adjust pitch finder params
2024-03-16 19:42:37 +08:00
an-lee
824c25272a make dmg 2024-03-01 19:43:14 +08:00
an-lee
5c3a750442 fix build arm64 in x64 runner 2024-03-01 19:43:14 +08:00
an-lee
ded7371be6 Feat: integrate deposit (#363)
* create deposit payment

* display recent deposits & improve UI

* support Mixin pay
2024-02-28 15:29:07 +08:00