Commit Graph

99 Commits

Author SHA1 Message Date
an-lee
824c25272a make dmg 2024-03-01 19:43:14 +08:00
an-lee
5c3a750442 fix build arm64 in x64 runner 2024-03-01 19:43:14 +08:00
an-lee
ae775e91ea Fix: ensure AI command model support json response_format (#365)
* ensure AI command model support json response_format

* update models list

* update tts model list
2024-02-28 22:32:48 +08:00
an-lee
ded7371be6 Feat: integrate deposit (#363)
* create deposit payment

* display recent deposits & improve UI

* support Mixin pay
2024-02-28 15:29:07 +08:00
an-lee
48eb5bd36f ensure transcription created before transcribe (#344) 2024-02-23 20:36:46 +08:00
an-lee
74e061ccac fix messages findOne (#342) 2024-02-22 22:17:46 +08:00
an-lee
8037273549 Feat: add tts conversation (#341)
* may create tts type conversation

* support tts reply

* upgrade deps

* test: e2e for create TTS conversation

* test: e2e for gpt conversation

* test: e2e for from create conversation to add speech audio to library

* refactor use-conversation

* generate speech before create msg in tts conversation

* refactor conversation-shorts

* revert change in 1000-hours

* revert sass dep changed in 1000-hours

* fix CI
2024-02-22 16:00:17 +08:00
an-lee
ce49b68ba3 toast error when recording save failed 2024-02-20 09:05:40 +08:00
an-lee
650a00b6a4 refactor transcode method 2024-02-20 09:00:58 +08:00
an-lee
7a0d348e11 ensure recording transcode to wav before saved 2024-02-20 07:16:20 +08:00
an-lee
47315aa1e4 fix recording 2024-02-20 07:02:43 +08:00
an-lee
bb06c9e191 tweak media player control 2024-02-20 06:17:52 +08:00
an-lee
daef3a4fa1 tweak UI 2024-02-19 22:05:16 +08:00
an-lee
60503aec35 Upgrade deps (#329)
* upgrade deps

* fix langchain warnings

* add test for login
2024-02-19 17:39:28 +08:00
an-lee
0aae7bcdd9 Feat remove extra settings when setup (#328)
* required login only when setup

* add default library path test

* add more whisper model options
2024-02-19 16:06:47 +08:00
an-lee
f75912ff8b Feat use ffmpeg static (#327)
* use ffmpeg static if valid

* transcribe after decoded
2024-02-19 14:12:06 +08:00
an-lee
06f8d32169 Feat improve media player page (#320)
* download transcription from api when transcribed

* add friendly loading panel on audio page

* add loading panel for video page

* fix locale

* remove ubuntu 20.04 for e2e test

* do not auto upload recording
2024-02-19 11:01:52 +08:00
an-lee
9a605b9f39 Feat: Improve first setup (#319)
* remove whisper model checking when setup

* fix landing page step

* refactor whisper

* refactor whisper options

* update workflow

* update test-enjoy-app.yml
2024-02-18 16:31:52 +08:00
an-lee
da09134e37 Feat: display download progress (#315)
* cache tedtalk download url

* improve tedtalk download ux

* display progress bar

* fix locale

* update UI

* display progress when downloading audbile
2024-02-18 09:27:51 +08:00
an-lee
57d6efa547 Feat: refactor ffmpeg config (#296)
* bundle ffmpeg wasm in package

* remove ffmpeg discover & add ffmpeg-static

* fix ffprobe-static version

* fix metadata generate

* fix auto transcribe if pending

* remove console.log
2024-02-11 17:21:39 +08:00
an-lee
bc22a5e2b4 Feat: refactor STT service (#294)
* add stt hook interface

* fix crypto exported to browser

* refactor use-transcribe

* may use openai stt

* refactor: remove decprecated codes

* fix undefined method
2024-02-10 19:55:07 +08:00
an-lee
338ef82a1e Fix recording sync (#291)
* delete audio/video/recording in remote

* sync recordings on profile page

* handle recording sync failed
2024-02-09 18:24:36 +08:00
an-lee
a95c247c8c Refactor whisper config (#287)
* may use custom whisper exe

* refactor whisper config code

* display progress when using local whisper transcribe
2024-02-09 17:07:21 +08:00
liangyi
5eafd45ac5 fix: setting options padding to show option border (#286) 2024-02-09 15:38:10 +08:00
an-lee
9f3cab831c Fix locale & enjoyai config & refactor filename (#279)
* max retries = 3 for enjoyai

* refactor file name

* update locale
2024-02-07 12:16:25 +08:00
an-lee
37cb3c7fe8 Improve player controls & assessment display (#275)
* zoom to fit as default

* display phoneme score in assessment
2024-02-06 23:59:19 +08:00
Percy Lee
de713caa9e fix: font display problem. (#252)
* fix: font display problem.

* Revert "fix: font display problem."

This reverts commit c20bbf8ce508ad0e256166714da2668ad01d6ad8.

* fix: change icon font color

* fix: icon font color.

---------

Co-authored-by: lixiancan <lixc.percy@gmail.com>
2024-02-05 21:08:00 +08:00
Percy Lee
f0c8ec79d6 fix typo (#254)
* fix: redundant ")"

* Fix typo.

* Fix typo.

---------

Co-authored-by: lixiancan <lixc.percy@gmail.com>
2024-02-02 23:10:34 +08:00
an-lee
e1f52e609e Fix bugs (#250)
* lint

* fix some lint error

* fix window hide error when size zero

* toast error when lookup failed

* resolve #239
2024-02-02 14:40:11 +08:00
Percy Lee
1868e27c0f fix:avoid unnecessary import. (#237)
Co-authored-by: lixiancan <lixc.percy@gmail.com>
2024-02-02 14:03:07 +08:00
an-lee
f6dcf0366f Fix: window hide & show, toast error for llm (#249)
* fix window hide & show

* toast error when llm failed
2024-02-02 13:56:52 +08:00
an-lee
3ffc0746f3 Fix: cannot login in Windows (#248)
* fix view-load failed in windows

* refactor
2024-02-02 12:46:40 +08:00
an-lee
799e8b3ea6 Fix bugs (#245)
* fix lookup word

* prevent navigate to oauth url
2024-02-02 01:35:25 +08:00
an-lee
abde169ead Fix openai proxy (#244)
* add create messages in batch

* add use conversation

* update conversation shortcut

* add speech handler

* tts in renderer

* fix speech create
2024-02-02 00:41:23 +08:00
an-lee
05bfd46a88 prevent redirect the oauth callback url (#243) 2024-02-01 22:11:32 +08:00
an-lee
51a810fdfd Feat: may setup proxy (#238)
* add https proxy

* remove proxy in renderer

* proxy work for openai request

* use proxyAgent to enable system proxy

* add proxy setting

* tweak proxy setting
2024-02-01 15:33:37 +08:00
an-lee
92b9eceba1 Fix conversation edit failed & Mixin login (#236)
* fix redundant toast error

* fix Mixin login failed on occasions

* fix conversation form default values
2024-01-31 10:39:54 +08:00
an-lee
ea462196af fix check update in about 2024-01-31 02:21:05 +08:00
an-lee
99671f90e8 typo (#233) 2024-01-31 01:50:45 +08:00
Percy Lee
a672dc709e fix: fix bugs (#218) & (#227) (#231)
Co-authored-by: lixiancan <lixc.percy@gmail.com>
2024-01-31 01:44:21 +08:00
an-lee
ff1999c00b Fix bugs (#232)
* fix default engine settings

* fix conversation & cloudflare transcribe

* update arm64/darwin whisper

* empty notice for conversations

* display user rankings

* fix enjoy ai

* update whisper.cpp for arm64 darwin to v1.5.4

* upgrade yarn to 4.1.0
2024-01-31 01:40:14 +08:00
an-lee
00cbc8403b Feat: add Enjoy AI as option (#206)
* add enjoyAI as option

* use enjoyai config

* may call enjoyai

* may set default ai engine

* refactor setting context

* refactor preferences

* add warning when openai key not provided

* tweak locale

* update duration for audio/video

* add balance settings

* may select ai role when create conversation

* may forward message from conversation

* tweak ui

* refactor transcribe method

* refactor ai commands to hooks

* fix webapi

* tweak playback rate options

* add playMode, next & prev, ref: #124

* upgrade deps

* may skip whisper model download

* audios/videos default order by updated_At
2024-01-31 00:04:59 +08:00
an-lee
cec9d73bc8 Feat: transcribe from web (#204)
* add transcribe from web

* transcribe from web

* add azure speech ai

* fix azure speech output

* may select stt service

* fix UI

* remove debug code

* lint

* fix default stt service

* tweak

* fix secondsToTimestamp
2024-01-27 00:45:06 +08:00
an-lee
99577c5020 Feat: more login methods (#195)
* add login code api

* use container for webview

* improve browserview

* may login via xuesheng account

* locale

* fix ui
2024-01-25 11:02:26 +08:00
an-lee
ff14e1d04a Fix: record without ffmpeg & others (#201)
* remove ffmpeg transcode when save recording

* fix model download

* trancode record audio in renderer

* fix transcribe dead loop when whisper not working

* force to select a model

* check model before transcribe
2024-01-24 15:05:56 +08:00
an-lee
506ea39ccb fix duplicated catch error (#194) 2024-01-23 16:10:51 +08:00
an-lee
51a71df326 keep loop when audio finish (#193) 2024-01-23 15:53:12 +08:00
an-lee
3a98bd9f40 Feat: use ffmpeg wasm (#177)
* add ffmepg wasm

* refactor whisper config

* refactor ffmpeg config

* remove depected codes

* refactor model download

* decouple whipser & ffmpeg when transcribe

* do not always toast not found error

* ffmpeg works in renderer

* transcode in renderer & transcript in main

* improve transcode

* refactor

* remove ffmpeg check

* fix whisper config check

* update whisper check

* enable SharedArrayBuffer

* remove ffmpeg setting

* fix UI

* handle ffmpeg not ready

* may create issue when whisper check failed

* upgrade deps

* hide ffmpeg setting if not ready

* hide record button when not in region
2024-01-23 14:39:16 +08:00
an-lee
f9fbb80f63 use baseUrl of openai config in command (#178) 2024-01-20 17:54:08 +08:00
an-lee
fe8f14bda7 ask for media access before record (#172) 2024-01-20 10:49:53 +08:00